AI · 6h ago
Open-source tool lets you peek inside an AI's 'thoughts' before it speaks
A developer built Lucid, a free web tool that visualizes and edits the internal representations of small open-source language models. Based on Anthropic's Jacobian Lens technique, it shows which concepts activate in middle layers before a word is chosen. Users can also inject concepts like 'fire' into the model's internal state to alter its output.
Meridian48 take
While limited to small models and early-stage research, this tool offers a tangible glimpse into mechanistic interpretability that could eventually improve AI alignment and bias detection.
Read the full reporting
Show HN: I built a web tool to see and edit what an AI thinks before it answers →
Hacker News
interpretabilityopen-source