The Workspace: What It's Thinking About

🧠 Inside the Workspace

Not what it's about to say — what it's thinking about while it decides.

Logit lens“What word would you say next?” — one answer per layer.
Workspace readout“What concepts are live right now?” — many at once, rising and fading.

Same sentence, different landmark — watch which lights change and which don't.

Input—
Layer — tap to look inside
Starting at the bottom…
What kind of sentence is this
What it's actually about
Tap any concept
Each light is one concept the model has learned. Tap one to see what else switches it on — that's how you work out what it means.

Tap a layer to freeze it, tap a concept to inspect it

Think of it as a shared noticeboard every part of the model reads from and writes to. Early layers post rough notes, middle layers post concepts, late layers read the board and commit to an answer. The logit lens only ever shows you the final word; this shows you the reasoning that produced it — including the options it held and dropped.
Illustrative concepts. Real feature readouts are pulled with sparse autoencoders and browsed in tools like Neuronpedia.