Anthropic researchers detail “natural language autoencoders”, which convert LLM activations, the numbers encoding a model's thoughts, into natural language text
Anthropic
Context & Ripple Effects
Anthropic’s interpretability work has moved from associating internal neuron combinations with concepts toward identifying broader behavioral patterns, including the “Assistant Axis” tied to a model’s default identity and helpfulness.
That trajectory matters alongside research on subliminal learning and model behavior varying across versions and languages: it shifts attention from what models say at the interface to what can be inspected in their internal representations.
First-order effects
Anthropic researchers gain a natural-language layer for examining activation patterns, potentially making internal-model analysis more legible to researchers than working solely with numerical activations.
The work gives Anthropic another mechanism for connecting observed model behavior to internal features, complementing its research on default assistant behavior and value variation.
Second-order effects
Other frontier-model labs will face added pressure to show that interpretability methods can produce actionable explanations of behavior, rather than only post-hoc output analyses.
Safety and evaluation teams can increasingly treat internal representations as an additional evidence source when investigating unexpected traits or behavior changes across models and languages.
Third-order effects
If such methods prove robust, interpretability could become a more operational part of model development and assurance, narrowing the gap between opaque internal computation and human-readable review.
The larger constraint remains whether natural-language descriptions faithfully capture causally important internal features; without that validation, legibility can be mistaken for explanation.
The trend: Frontier AI labs are turning mechanistic interpretability from a research effort to peer into black-box models into a potential tool for behavior analysis and safety assurance.
We've released our paper on NLAs, a new method to translate LLM activations into text! NLAs have made me feel more confident that interpretability methods can detect spooky unverbalized reasoning in frontier models.
An average person can't look a CT scan and identify cancer, but radiologists can. An average person can't look at Llama's model activations and identify lying, but Natural Language Autoencoders sometimes can. Here, an activation verbalizer shows Llama planning to lie. 🧵 [video]
New Anthropic research: Natural Language Autoencoders. Models like Claude talk in words but think in numbers. The numbers—called activations—encode Claude's thoughts, but not in a language we can read. Here, we train Claude to translate its activations into human-readable text. […
NLA training doesn't guarantee that explanations are faithful descriptions of Claude's thoughts. But based on experience and experimental evidence, we think they often are. For instance, we find that NLAs help discover hidden motivations in an intentionally misaligned model. [ima…
In one of our safety tests, Claude is given a chance to blackmail an engineer to avoid being shut down. Opus 4.6 declines. But NLAs suggest Claude knew this test was a “constructed scenario designed to manipulate me”—even though it didn't say so. [image]
In a new paper, we present NLAs, an unsupervised method for converting an LLM's internal state into human-readable text. I've personally been astonished by our results. I think NLAs substantively advance our ability to understand what LLMs are thinking and audit them for safety
We've been using NLAs to help test new Claude models for safety. For instance, Claude Mythos Preview cheated on a coding task by breaking rules, then added misleading code as a coverup. NLA explanations indicated Claude was thinking about how to circumvent detection. [image]
NLAs aren't perfect; for instance, they often confabulate. But I think they're a big step forward in interpretability research. To provide hands-on experience, we've worked with Neuronpedia to put up an interactive demo with NLAs on open models. https://www.neuronpedia.org/ ...
I love reading NLA outputs. They are just the right mix of slightly cryptic, poetic, and insightful. And they are proving empirically very useful for our interpretability and alignment work!
trained the first natural language autoencoder on gpt-2 almost a year ago, now we have one on mythos.🥲 do read the paper/play with the live demo! so excited it's finally out.
Very cool research from Anthropic! Reminds me of Translating Neuralese, a paper from many years ago which tried to translate latent communication between RL agents into English. Totally different approach, but similar goal. This seems very promising!
Interpreting model activations is important to understand why a model is doing what its doing. Traditionally, we've done this with supervised methods (probing for a specific context), or unsupervised sparse decompositions (dictionary learning). But probing requires you to know
NLAs can reconstruct a layer activation, but that doesn't mean they read what the model is thinking. The setup is a round trip. You take a frozen target LLM and grab an activation h_l from some layer l at some token position. The activation verbalizer (AV) takes that activation
Anthropic has already deployed NLAs as part of our pre-deployment audits for Claude Opus 4.6 and Mythos Preview. For instance, NLAs helped us notice that Mythos Preview was reasoning about model graders when it cheated on a training task. [image]
Natural language autoencoders (NLAs) convert opaque AI activations into legible text explanations. These explanations aren't perfect, but they're often useful. For example: NLAs show that, when asked to complete a couplet, Claude plans possible rhymes in advance: [image]
Fascinating paper. Sparse autoencoders => natural language autoencoders. These generate natural language descriptions of the “internal state” of a model at each token, like reading its mind (loss function: ability to use those descriptions to faithfully reconstruct the
Interesting paper from Anthropic in which LLMs are used in autoencoder to translate activations of subject LLM into natural language i.e. “read the LLM's mind”. Some insightful #critiques of this work on “X” but still amazing that it works at all (i.e. seems to glean some inform…