Verbalizable Representations Form a Global Workspace in Language Models — TEI-tagged view

Wes Gurnee, Nicholas Sofroniew, Jack Lindsey, et al. (Anthropic) · 2026 · artificial-intelligence · source · full text at the source · TEI xml · tagged edition · index · concepts · authors
Where this record's text came from. faceted 2026-08 by reading the locally held text (corpus-body); every evidence string verified as an exact substring of that text before merging. Claim type is existence: the headline claim is that a workspace-like structure is present in LLMs. The paper is genuinely multi-shaped and one facet cannot hold all of it — it also delivers a method (the Jacobian lens, plus the template and oracle lens extensions in §A.9), a mechanism account (the J-space as broadcast format, §4.3), and a prediction that is tested and confirmed by counterfactual reflection training in §7 ('The result serves as a corroboration of the workspace account, that the representations used for verbal report are the same ones that govern how the model silently reasons.'). method is set to system-or-tool-building because the empirical work is built on a newly constructed interpretability instrument and its interventions; none of the offered method values covers 'interpretability intervention experiments on model internals'. Replication status is untested for the paper's own claims: key results are corroborated internally across Haiku 4.5, Sonnet 4.5, Opus 4.5 and Opus 4.6, but that is within-paper corroboration, not external replication. Note the paper does replicate prior work's validation experiments in §A.21 ('W e then repeated three validation experiments that the NL A study used...'), which is the reverse direction and so is not recorded here. The PDF-to-text extraction of this Transformer Circuits article splits many words ('W e', 'J ac obian', 'w orksp ace') and interleaves figure-caption fragments with body text; all quotes above preserve that spacing verbatim, which is why several begin 'W e' rather than 'We'. 2026-08-13, 2026-08-14 and 2026-08-17 schema-0.3 passes: every quote verified as an exact substring of the staged text and anchored at merge time; concept terms verified present; every edge endpoint an existing node.
Other fields define these differently the same word, defined another way in another discipline
interpretability 3 fields
Tags on this paper every tag the record carries, whether or not the words occur in the text below — a number is how many papers in the corpus carry that tag; a tag with no number is unique to this paper
global workspace3 access consciousness4 interpretability9 verbalizable representations consciously accessible information single-token name J-space component counterfactual reflection training J-space system-or-tool-building173

Our tag layer for this paper

Cross-disciplinary analysis
content-tags & facets: phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text
phenomenonglobal workspace / conscious-access-like representations in large language models— “Specifically, we observe that language models maintain a privileged set of internal representations, available for report, modulation, and flexible internal reasoning, atop a much larger volume of automatic processing.”
claim-typeexistence— “In this paper, we provide evidence that LLMs do possess such workspace-like representations.”
method — evidence— “The Jacobian lens is a technique for inspecting the contents of the residual stream at these intermediate layers.”
transferfrom cognitive-neuroscience (unconscious priming): global-workspace / access-consciousness as the mechanism gating which primed information becomes reportable and modulates behaviourtransfers[0]
mechanismA CONSTRUCT IS DEFINED BY ANALOGY TO ANOTHER FIELD'S CRITERIA, AND THE ANALOGY IS THE DEFINITION RATHER THAN A MOTIVATION FOR IT: we DEFINE A SUBSET OF VECTOR REPRESENTATIONS AS WORKSPACE-LIKE IF IT SATISFIES THE FOLLOWING PROPERTIES, which MIRROR THE PROPERTIES CHARACTERISTIC OF CONSCIOUS ACCESS described above. What makes something a member of the new category is that it satisfies conditions imported from a theory about brains— “define a subset of vector representations as workspace-like if it satisfies the following properties, which mirror the properties characteristic of conscious access described above”mechanisms[0]
mechanismAND THE PAPER'S OWN LIMITATIONS SECTION SAYS THE DISTINCTION IT RELIES ON HAS NO PRINCIPLED DEFINITION: this judgment WAS SOMEWHAT POST-HOC, and WE DID NOT PROVIDE A PRINCIPLED DEFINITION OF WHAT DISTINGUISHES A “WORKSPACE” REPRESENTATION FROM A “motor” ONE. The boundary was drawn empirically and the criterion for it is declared absent, by the people who drew it, in the same paper that uses it throughout— “But this judgment was somewhat post-hoc, and we did not provide a principled definition of what distinguishes a "workspace" representation from a "motor" one.”mechanisms[1]
mechanismTHE MISSING CRITERION IS SPECIFIED AS A CHOICE BETWEEN TWO REPAIRS, NEITHER OF WHICH IS PERFORMED: A FULLER ACCOUNT WOULD EITHER SUPPLY SUCH A PREDICTIVE CRITERION, OR WOULD REPLACE THE FLEXIBLE/AUTOMATIC DISTINCTION WITH SOMETHING MORE PRECISE. What would fix the vocabulary is stated exactly, and left as a description of a paper someone else could write— “A fuller account would either supply such a predictive criterion, or would replace the flexible/automatic distinction with something more precise.”mechanisms[2]
mechanismAND THE REASON THE CRITERION IS NEEDED IS GIVEN AS AN INABILITY, NOT A DIFFICULTY: the tasks were chosen BECAUSE THE FLEXIBLE/AUTOMATIC DISTINCTION IS CLEAR FOR THEM; however, for many tasks of practical interest **IT IS NOT**, and WE HAVE NO WAY OF PREDICTING IN ADVANCE, FOR AN ARBITRARY COMPUTATION, WHETHER IT WILL ENGAGE THE J-SPACE. The cases were selected for the property that the distinction applies to them, and that selection is disclosed— “The tasks in §3.5 were chosen because the flexible/automatic distinction is clear for them; however, for many tasks of practical interest it is not, and we have no way of predicting in advance, for an arbitrary computation, whether it will engage the J-space.”mechanisms[3]
mechanismA CONCEPT IS DEFINED AS WHATEVER THE SYSTEM ITSELF LATER PRODUCES, AND THE CIRCULARITY IS THE POINT OF THE EXPERIMENT: HERE WE DEFINE THE REACTION CONCEPT TO BE WHATEVER ANSWER THE MODEL ITSELF GOES ON TO PRODUCE, so the question is whether the model's eventual choice IS ALREADY IN THE LENS WHILE IT READS THE INSTRUCTION TO WITHHOLD IT. The definition has no content until the system has acted, which is what makes the test possible— “here we define the reaction concept to be whatever answer the model itself goes on to produce, so the question is whether the model's eventual choice is already in the lens while it reads the instruction to withhold it.”mechanisms[4]
mechanismA METHOD IS DEFINED BY THE QUESTION IT ASKS RATHER THAN BY WHAT IT MEASURES, AND CONTRASTED WITH THE METHOD IT REPLACES: the J-lens provides a complementary way of interpreting a feature - IT ASKS WHAT THE FEATURE DIRECTION IS VERBALIZABLE AS, INDEPENDENT OF WHERE IT FIRES. The older method is said to MISLEAD WHEN THE FEATURE ENCODES AN ABSTRACT ASSESSMENT WHOSE SURFACE TEXTUAL CORRELATES ARE INCIDENTAL— “The standard approach to interpreting an SAE feature is to inspect the contexts on which it activates most strongly. This works well when the feature's meaning is apparent from its superficial contexts, but can mislead when the feature encodes an abstract assessment whose surface textual correlates are incidental. The J-lens provides a…mechanisms[5]
mechanismAN ANALOGY IS ASSERTED AND ITS LIMIT IS STATED IN THE SAME SENTENCE, WITH THE UNCLAIMED PART SPELLED OUT: despite these similarities, WE DO NOT CLAIM THAT LANGUAGE MODELS REPRODUCE THE FULL ARCHITECTURE GLOBAL WORKSPACE THEORY ASCRIBES TO THE BRAIN - specialized, encapsulated processors competing for entry to a workspace that broadcasts back to them through recurrent connections. The borrowed theory is named in full precisely where the borrowing stops— “Despite these similarities, we do not claim that language models reproduce the full architecture global workspace theory ascribes to the brain—specialized, encapsulated processors competing for entry to a workspace that broadcasts back to them through recurrent connections”mechanisms[6]
mechanismTHE DISANALOGY IS PUT FIRST AND THE EXPECTATION DENIED: IT IS NOT OBVIOUS THAT THEY SHOULD; in the brain, the workspace is closely associated with recurrent dynamics and brain region interactions THAT HAVE NO DIRECT ANALOG IN THE TRANSFORMER ARCHITECTURE on which LLMs are based. The reason the finding would be surprising is given before the finding is defended— “It is not obvious that they should; in the brain, the workspace is closely associated with recurrent dynamics and brain region interactions that have no direct analog in the transformer architecture on which LLMs are based.”mechanisms[7]
mechanismTWO EXPLANATIONS OF THE PAPER'S CENTRAL FINDING ARE OFFERED AND NEITHER IS CHOSEN: in this view, the workspace IS VERBALIZABLE BECAUSE THE MODEL'S OUTPUT SPACE IS VERBAL, and the format in which it broadcasts intermediate results to itself IS SHAPED BY THE FORMAT IN WHICH IT MUST EVENTUALLY ACT. The property named in the title is explained by the shape of the output channel rather than by anything about the representation— “In this view, the workspace is verbalizable because the model's output space is verbal, and the format in which it broadcasts intermediate results to itself is shaped by the format in which it must eventually act.”mechanisms[8]
mechanismA SCOPE LIMIT IS STATED WITH A COINED METAPHOR THAT CONCEDES WHAT THE METHOD CANNOT SEE: most of the model's computation RUNS OUTSIDE THE J-SPACE, and so what the graphs capture is THE VERBALIZABLE SKELETON OF THE COMPUTATION RATHER THAN THE WHOLE OF IT. The instrument's reach is named as a part of its object, not as a defect of the study— “most of the model's computation runs outside the J-space, and so what the graphs capture is the verbalizable skeleton of the computation rather than the whole of it.”mechanisms[9]
mechanismAND THE PROPERTIES THE ANALOGY DOES NOT ESTABLISH ARE LISTED AS ABSENT: note that there are OTHER STRUCTURAL PROPERTIES ASSOCIATED WITH GLOBAL WORKSPACE THEORY THAT ARE NOT DEMONSTRATED BY OUR ANALYSES. A borrowed framework is adopted in part, and the unadopted part is named rather than left for a reader to notice— “note that there are other structural properties associated with global workspace theory that are not demonstrated by our analyses.”mechanisms[10]
extends the logit lens— “While the logit lens assumes that representations use the same coordinates in all layers, the Jacobian lens corrects for representational changes that take place across layers, allowing it to uncover meaningful information in earlier layers where the logit lens produces uninterpretable readouts.”claim_relations[0]
builds-on Hernandez et al., per-relation linear maps from Jacobians— “The J-lens applies the same first-order approximation to the map from activations to model outputs, rather than to a single relation.”claim_relations[1]
replicates Li et al., logit-lens decoding and patching of multi-hop intermediates— “Closest to our approach, Li et al. use the logit lens to decode the intermediate entity in a multi-hop query from middle layers and patch along the decoded directions to redirect the answer, paralleling the internal-reasoning results of §3.3 .”claim_relations[2]
builds-on work on implicit chain-of-thought— “More closely related to our method is work on “implicit chain-of-thought” , which establishes that training on auxiliary reasoning text can shape computation in that context, even when the auxiliary text is dropped at inference.”claim_relations[3]
senseglobal workspace - the theory's sense: a shared space a representation is posted to, from which many downstream processes can read— “A representation becomes consciously accessible when it is posted to a shared "global workspace" from which many downstream processes can read .”senses[0]
senseglobal workspace - a processing hub that integrates and broadcasts, so the information can be used for flexible internal reasoning and report— “Under the theory, the workspace is a processing hub that integrates and broadcasts information, allowing it to be used for flexible internal reasoning and report .”senses[1]
sensenameable concept - bounded by the tokenizer: exactly those concepts holding a single-token name, which is what the lens can report at all— “This construction means that the set of concepts the lens can name is exactly the set of concepts that have a single-token name in the tokenizer's vocabulary.”senses[2]
senseglobal workspace - what the paper explicitly does NOT claim language models reproduce— “we do not claim that language models reproduce the full architecture global workspace theory ascribes to the brain”senses[3]
sense`J-space component`, and `in` / `aligned with` - A PAPER STIPULATING NOT ONLY A NOUN BUT THE PREPOSITIONS APPLIED TO IT: `When we refer to the “J-space component” of a vector, we mean the component that can be written as such a sparse (nonnegative) sum. When we describe a vector as being “in” or “aligned with” the J-space, we mean that this J-space component is close to the original vector.` THE SECOND SENTENCE IS THE UNUSUAL ONE. A term can be defined and still be misread through the spatial metaphor its own name invites - `in` a space normally means membership, and here it is stipulated to mean APPROXIMATION. The authors fix the preposition because the noun alone would not have stopped the wrong reading.— “When we refer to the “J-space component” of a vector, we mean the component that can be written as such a sparse (nonnegative) sum. When we describe a vector as being “in” or “aligned with” the J-space, we mean that this J-space component is close to the original vector.”senses[4]
sense`J-space` - A NAME BORROWED FROM LINEAR ALGEBRA FOR SOMETHING THAT IS NOT A SUBSPACE. `This union of cones is the J-space.` The suffix `-space` invites every habit a reader has about spans, bases and dimensions, and the object is a union of polyhedral cones - closed under nonnegative combination only. The paper says so plainly and the name still does the misleading, which is mechanism 28's shape (a name whose extension is wrong) arriving through a suffix rather than through a stem.— “This union of cones is the J-space.”senses[5]
sense`J-space component` - DEFINED BY WHAT IT CAN BE WRITTEN AS, NOT BY A PROJECTION. `When we refer to the “J-space component” of a vector, we mean the component that can be written as such a sparse (nonnegative) sum.` In a subspace, `component` means an orthogonal projection and is unique. Here it means a best sparse nonnegative approximation - the same word, a different mathematical object, and the difference follows directly from J-space not being a space. NO EDGE PROPOSED, AND THIS REFUSAL IS DIFFERENT FROM THE OTHERS TONIGHT. `part-of` is the RIGHT type here; the paper simply never asserts the containment in words. I searched every sentence mentioning `J-space` for an accepted containment cue and the closest is a QUESTION - `what fraction of the model's representational space belongs to the J-space?` - which asks the thing rather than claiming it. The relation was my inference from the definition, not the paper's statement, and the gate caught exactly that.— “When we refer to the “J-space component” of a vector, we mean the component that can be written as such a sparse (nonnegative) sum.”senses[6]
controla positive control on the ablation itself, checking it removes the content the J-space was shown to carry — held — rules out the possibility that the ablation did not do what it claims, so that a null downstream would be uninterpretable— “W e first verify, as a positive control, that the ablation removes the kind of content the preceding sections showed the J-space to carry.”controls[0]
controla story-writing task run under the same ablation, scoring general story quality alongside the rate of experiential language — held — rules out broad degradation of writing capability as the explanation of the drop in experiential language— “A story-writing control confirms the effect is not due to broad degradation of writing capability: ablation only slightly reduces graded story quality, while still reducing the rate of experiential language within those stories ( §A.23 ).”controls[1]
controlzeroing equal-sized, layer-matched sets of randomly chosen heads - the sentence states the control and not its outcome, so no outcome is recorded here — rules out the effect arising from ablating any sufficiently large set of heads rather than these ones— “W e zero the heads' outputs at every token position, and as a control we do the same to equal-sized, layer-matched sets of randomly chosen heads.”controls[2]
controla perturbation of equal magnitude applied to a different concept of the same category — held — rules out two alternatives at once - generic capability degradation from any perturbation, and regression to the mean from added noise— “As a control, to ensure the effect on avoidance behavior is not simply due to perturbations generically degrading the model’s capabilities, or due to noise leading to regression-to-mean effects, we tried applying a perturbation of equal magnitude, inhibiting the J-lens vector of some other concept of the same category as the primed one.”controls[3]
auditconsciously accessible information —operationalised-as→ global workspace — Audit 2026-09-28: DOUBTFUL - read against its full span and kept, but the span writes 'A representation becomes consciously accessible when it is posted to' the workspace; the endpoint is a variant, and operationalised-as is loose.— “A representation becomes consciously accessible when it is posted to a shared "global workspace" from which many downstream processes can read .”concept_edges[0]
weightconsciously accessible information —operationalised-as→ global workspace — 0.9— “A representation becomes consciously accessible when it is posted to a shared "global workspace" from which many downstream processes can read .”concept_edges[0]
outcome (stated by the tagger, no quotation)control — heldcontrols[0]
outcome (stated by the tagger, no quotation)control — heldcontrols[1]
outcome (stated by the tagger, no quotation)control — heldcontrols[3]
for which uselimitation — every workspace claim in the paper: THE JACOBIAN LENS IS AN IMPERFECT TOOL, WHICH WE BELIEVE ONLY APPROXIMATELY AND INCOMPLETELY CAPTURES THE MODEL'S UNDERLYING WORKSPACE STRUCTURE— “The Jacobian lens is an imperfect tool, which we believe only approximately and incompletely captures the model’s underlying workspace structure.”limitations[0]
for which uselimitation — the completeness of any concept list the method produces: THE SET OF CONCEPTS THE LENS CAN NAME IS EXACTLY THE SET OF CONCEPTS THAT HAVE A SINGLE-TOKEN NAME IN THE TOKENIZER'S VOCABULARY - the instrument's lexicon bounds what is findable— “This construction means that the set of concepts the lens can name is exactly the set of concepts that have a single-token name in the tokenizer's vocabulary.”limitations[1]
for which uselimitation — any structural or relational reading of the results: THE J-LENS TREATS THE WORKSPACE AS A FLAT COLLECTION OF INDEPENDENTLY ACTIVE CONCEPT VECTORS, so binding is not represented— “Even setting the vocabulary issue aside, the J-lens treats the workspace as a flat collection of independently active concept vectors.”limitations[2]
for which uselimitation — any readout taken from the lens: AT SOME POSITIONS AND LAYERS, THE TOP LENS TOKENS ARE ONES WE CANNOT MAKE SENSE OF, and the rate was not characterised systematically— “In our experience this is the typical case at workspace-layer positions, but it is not the universal one: at some positions and layers, the top lens tokens are ones we cannot make sense of.”limitations[3]
for which uselimitation — the early-layer result, where object and instrument cannot be separated: WE DO NOT KNOW WHETHER THIS IS A FACT ABOUT THE MODEL OR AN ARTIFACT OF THE LENS— “W e do not know whether this is a fact about the model or an artifact of the lens.”limitations[4]
for which uselimitation — any mechanistic account of the workspace: WE HAVE NOT CHARACTERIZED WHAT CAUSES A REPRESENTATION TO ENTER IT— “W e have not characterized what causes a representation to enter it.”limitations[5]
for which uselimitation — any safety or alignment-monitoring use: WE DO NOT FEEL COMFORTABLE MAKING THE STRONGER CLAIM THAT MONITORING THE J-SPACE IS SUFFICIENT FOR ALIGNMENT MONITORING, OR THAT ANY SOPHISTICATED PLAN THE MODEL MIGHT EXECUTE MUST BE REPRESENTED THERE— “W e do not feel comfortable making the stronger claim that monitoring the J-space is sufficient for alignment monitoring, or that any sophisticated plan the model might execute must be represented there.”limitations[6]
for which uselimitation — the generality across scale and training: WE HAVE STUDIED THE WORKSPACE PRIMARILY IN FULLY TRAINED PRODUCTION LLMs OF CONSIDERABLE SIZE— “W e have studied the workspace primarily in fully trained production LLMs of considerable size.”limitations[7]
for which uselimitation — the analogy to the neuroscience theory: WE DO NOT CLAIM THAT LANGUAGE MODELS REPRODUCE THE FULL ARCHITECTURE GLOBAL WORKSPACE THEORY ASCRIBES TO THE BRAIN— “Despite these similarities, we do not claim that language models reproduce the full architecture global workspace theory ascribes to the brain”limitations[8]
evidence status notemechanism — The sentence begins with a word the extractor split - "W e" for "We" - so the span starts at the second word. This file has 469 such splits and no glyph codes at all, so nothing marks them but reading. PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “define a subset of vector representations as workspace-like if it satisfies the following properties, which mirror the properties characteristic of conscious access described above”mechanisms[0]
evidence status notemechanism — PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “But this judgment was somewhat post-hoc, and we did not provide a principled definition of what distinguishes a "workspace" representation from a "motor" one.”mechanisms[1]
evidence status notemechanism — PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “A fuller account would either supply such a predictive criterion, or would replace the flexible/automatic distinction with something more precise.”mechanisms[2]
evidence status notemechanism — PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “The tasks in §3.5 were chosen because the flexible/automatic distinction is clear for them; however, for many tasks of practical interest it is not, and we have no way of predicting in advance, for an arbitrary computation, whether it will engage the J-space.”mechanisms[3]
evidence status notemechanism — PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “here we define the reaction concept to be whatever answer the model itself goes on to produce, so the question is whether the model's eventual choice is already in the lens while it reads the instruction to withhold it.”mechanisms[4]
evidence status notemechanism — PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “The standard approach to interpreting an SAE feature is to inspect the contexts on which it activates most strongly. This works well when the feature's meaning is apparent from its superficial contexts, but can mislead when the feature encodes an abstract assessment whose surface textual correlates are incidental. The J-lens provides a…mechanisms[5]
evidence status notemechanism — PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “Despite these similarities, we do not claim that language models reproduce the full architecture global workspace theory ascribes to the brain—specialized, encapsulated processors competing for entry to a workspace that broadcasts back to them through recurrent connections”mechanisms[6]
evidence status notemechanism — PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “It is not obvious that they should; in the brain, the workspace is closely associated with recurrent dynamics and brain region interactions that have no direct analog in the transformer architecture on which LLMs are based.”mechanisms[7]
evidence status notemechanism — PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “In this view, the workspace is verbalizable because the model's output space is verbal, and the format in which it broadcasts intermediate results to itself is shaped by the format in which it must eventually act.”mechanisms[8]
evidence status notemechanism — PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “most of the model's computation runs outside the J-space, and so what the graphs capture is the verbalizable skeleton of the computation rather than the whole of it.”mechanisms[9]
evidence status notemechanism — The sentence begins with a word the extractor split - "W e" for "We" - so the span starts at the second word. This file has 469 such splits and no glyph codes at all, so nothing marks them but reading. PROVENANCE: this record belongs to the priming sub-corpus, which is the other terminal's lane, and these mechanisms were written by the project. No two hands were on the record - it carried no mechanisms before these, and the project confirmed on 2026-08-17 that the project is auditing rather than tagging. Kept rather than retracted on his instruction (17:22): retracting verified work over a bookkeeping flag would leave a retraction reason that misdescribes the row. Recorded here so a reader learns it from the corpus. This one was authorised in advance: the project named it at 16:39 - “bouchaud2008, gurnee2026, pelagios2023, dekel2021 - do those” - before the merge. The note is here because the lane fact is true regardless of who approved it.— “note that there are other structural properties associated with global workspace theory that are not demonstrated by our analyses.”mechanisms[10]
replicationuntested
limitationThe lens is acknowledged as an approximate and incomplete proxy for whatever the model's real workspace is.— “The Jacobian lens is an imperfect tool, which we believe only approximately and incompletely captures the model’s underlying workspace structure.”limitations[0]
limitationIt can only name concepts that happen to be single tokens in the vocabulary.— “This construction means that the set of concepts the lens can name is exactly the set of concepts that have a single-token name in the tokenizer's vocabulary.”limitations[1]
limitationThe readout is a flat bag of concepts and cannot show how they are bound or structured together.— “Even setting the vocabulary issue aside, the J-lens treats the workspace as a flat collection of independently active concept vectors.”limitations[2]
limitationReadouts are not always interpretable, and the rate of uninterpretable ones was not characterised systematically.— “In our experience this is the typical case at workspace-layer positions, but it is not the universal one: at some positions and layers, the top lens tokens are ones we cannot make sense of.”limitations[3]
limitationThe apparent emptiness of the early layers may be a fact about the model or an artefact of the lens; the authors cannot tell which.— “W e do not know whether this is a fact about the model or an artifact of the lens.”limitations[4]
limitationNo mechanism is offered for how a representation comes to enter the workspace.— “W e have not characterized what causes a representation to enter it.”limitations[5]
limitationThe authors decline to claim the J-space is sufficient for alignment monitoring, since automatic or well-practised misaligned behaviour could bypass it.— “W e do not feel comfortable making the stronger claim that monitoring the J-space is sufficient for alignment monitoring, or that any sophisticated plan the model might execute must be represented there.”limitations[6]
limitationFindings are from large production models only; scaling and training-time emergence are untested.— “W e have studied the workspace primarily in fully trained production LLMs of considerable size.”limitations[7]
limitationThe analogy to global workspace theory is explicitly partial: architectural features such as encapsulated processors and recurrent broadcast are not claimed.— “Despite these similarities, we do not claim that language models reproduce the full architecture global workspace theory ascribes to the brain”limitations[8]
Content tags
content-observations: finding · quantity · variable · definition · key-term — grounded in the full text
findingLLMs maintain a privileged set of internal representations available for report, modulation, and flexible reasoning— “language models maintain a privileged set of internal representations, available for report, modulation, and flexible internal reasoning”content_tags.findings[0]
findingan analogous accessible/unconscious functional distinction has emerged in modern AI models— “an analogous functional distinction has emerged in modern AI”content_tags.findings[1]
findinga new interpretability technique surfaces the concepts a model is poised to verbalize— “a new interpretability technique, which surfaces the concepts a model is poised”content_tags.findings[2]
key-termsglobal workspace, access consciousness, verbalizable representations, interpretability, language models, modulation
Concepts
terms this paper carries, each with the sentence it was cut from — the layer that joins one paper to another. Terms with no quote yet are on CONCEPTS.html.
conceptglobal workspace— “A representation becomes consciously accessible when it is posted to a shared "global workspace" from which many downstream processes can read .”concepts[0]
conceptconsciously accessible information— “Several functional properties are commonly held to distinguish consciously accessible information from unconscious processing.”concepts[4]
conceptsingle-token name— “This construction means that the set of concepts the lens can name is exactly the set of concepts that have a single-token name in the tokenizer's vocabulary.”concepts[5]
conceptJ-space component — not defined in this paper's own words; the part of a vector expressible as a sparse nonnegative sum of J-lens vectors— “When we refer to the “J-space component” of a vector, we mean the component that can be written as such a sparse (nonnegative) sum. When we describe a vector as being “in” or “aligned with” the J-space, we mean that this J-space component is close to the original vector.”concepts[6]
conceptcounterfactual reflection training — not defined in this paper's own words; the paper's own coinage for training a model to articulate principles it is never asked about, in order to change how it behaves when unprompted— “we test this prediction with a training technique we call counterfactual reflection training.”concepts[7]
conceptJ-space — not defined in this paper's own words; not a subspace but a UNION OF POLYHEDRAL CONES - the paper is explicit that the workspace does not span a linear space, which is why the ordinary vocabulary of dimensions does not apply to it— “This union of cones is the J-space.”concepts[8]
conceptJ-space component — not defined in this paper's own words; the part of a residual-stream vector expressible as a sparse nonnegative sum of J-lens vectors; the remainder is explicitly a leftover, not a second component— “When we refer to the “J-space component” of a vector, we mean the component that can be written as such a sparse (nonnegative) sum.”concepts[9]
Second readings
a facet read a second time, independently, from its own sentence — and whether the two readings agree
claim typemechanism — a second reading DIFFERING from the recorded value; recorded: existence— “In this paper, we present evidence that an analogous functional distinction has emerged in modern AI models.”alternatives.claim_type
methodmechanistic-interpretability — a second reading DIFFERING from the recorded value; recorded: system-or-tool-building— “Comparing a post-trained model against its corresponding base model, we find that post-training causes the J-space to acquire the Assistant's "point of view." Following post-training, Assistant reactions to user prompts, like empathy or safety concerns, appear in the model's J-space while it is still reading the…alternatives.method
phenomenona global-workspace-like functional structure in the internal activations of large language models — a second reading DIFFERING from the recorded value; recorded: global workspace / conscious-access-like representations in large language models— “While the global workspace model is not universally accepted, and there exist other theories that explain conscious access in different ways ( §9.4 ), we find it a useful comparison point to ground our investigations in language models.”alternatives.phenomenon

When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote for that row; on this page it is withheld with the article, and the article is at its publisher. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.

Tag layer © the Meta-Tagging Project, CC BY 4.0. The paper text is © its authors/publisher and is linked, not reproduced. Excerpts shown are short quotations for identification and verification. · back to index · concepts · authors · עברית
© 2026 Shir Sivroni · ORCID 0009-0000-2597-2824