Latent Dirichlet Allocation

David M. Blei, Andrew Y. Ng, Michael I. Jordan · Journal of Machine Learning Research · 2003 · digital-humanities · record blei2003-lda
tag layer · index · concepts · authors · עברית
Where this record's text came from. faceted 2026-08 by reading the locally held text (pdftext); every evidence string verified as an exact substring of that text before merging. The PDF extraction is heavily garbled in the equation blocks and figures (long runs of (cid:NN) glyphs and scrambled math); all quotes were therefore taken from clean prose in the abstract, introduction, Sections 4, 6, 7 and 8, and each was substring-verified against the raw file. method was recorded as system-or-tool-building because the paper's core work is deriving a model plus its inference algorithms; it also contains an empirical evaluation on real corpora ("We trained a number of latent variable models, including LDA, on two text corpora to compare the generalization performance of these models."), which no single method value captures. Replication status is untested because the paper reports no replication of prior findings and none of it is reported as replicated within the text. 2026-08-14 and 2026-08-15 schema-0.3 passes: every quote verified as an exact substring of the staged text and anchored at merge time; concept terms verified present; every edge endpoint an existing node.
The quality of the text these quotes were cut from. symbol-font-not-extractable: mathematical notation is lost to '(cid:NN)' markers - 2983 of them, 26.2% of an internal file by character, but only 1.1% sit isolated in running prose (the rest cluster inside formulae). Sigma, Pi, >= and the starred optimum render as markers. 14 distinct codes with the top two accounting for 97% - ONE SYMBOL FONT WITH NO ToUnicode MAP, not a general extraction failure; a broken text font needs hundreds of codes. THE ARGUMENT OF THE PAPER IS READABLE AND TAGGABLE; THE EQUATIONS ARE NOT. 33 live quotes, 0 carrying a marker. The web page we fetched shows neither '(cid:NN)' nor '/H#####'. Some of this is recoverable from it, but LESS THAN IT LOOKS: of the marker slots whose surrounding text was itself undamaged enough to locate in the other copy - a small sample, since the context around a marker is usually markers - under half came back as a real character and the rest could not be aligned at all. Treat it as a partial repair, not a clean source.
How to read this page. The article itself is not reproduced here — this paper is not cleared for redistribution, so what follows is the tag layer alone. The evidence sentences are withheld with the article. The table at the foot lists every tag the record carries; each row names the facet it belongs to, and the whose words column says whether the tag records the paper's own wording or the tagger's sentence about the paper. Every tag links to each other paper in the corpus carrying it. The machine-readable edition of the same thing is the TEI file beside this one, where the tags live in standOff, and the article is at its publisher via the link below. When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote for that row; on this page it is withheld with the article, and the article is at its publisher. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.
Other fields define these differently the same word, defined another way in another discipline
generative model 3 fields · topic 2 fields

Tags on this paper

Every tag the record carries, each linking to every other paper in the corpus that carries it. A tag appears here whether or not its words occur in the article — the spans below are only the ones a sentence in this paper licenses. Of the 8 concept tags on this paper, 5 are grounded in a quoted sentence.
topic model latent Dirichlet allocation generative model latent multinomial variables exchangeability bag-of-words perplexity topic a generative probabilistic model: each document is a finite mixture over latent topics, and each topic a distribution over words document corpus mixture probabilistic words generative Dirichlet variational latent Dirichlet allocation (LDA) tf-idf scheme Bayesian mean mean of system-or-tool-building

Legend

second readingalternativesan independent re-reading of a facet, recorded whether or not it agrees
relation to other workclaim_relationshow this paper stands to another: agrees, contradicts, extends, qualifies
claim typeclaim_typethe shape of the claim: existence, mechanism, method, critique, prediction, null
concept edgeconcept_edgesan asserted relation between two concepts, with the sentence asserting it
conceptconceptsan idea the paper works with, quoted where the paper uses it
content tagcontent_tagsa finding, definition, quantity, statistic or variable named in the paper
controlcontrolsan experiment run to eliminate a rival explanation
limitationlimitationswhat the paper says its evidence cannot support
mechanismmechanismshow the reported effect is said to come about
methodmethodhow the paper produced its evidence
phenomenonphenomenonthe effect or regularity under study
sensesensesa distinct use of a term, quoted where the paper fixes it
transfertransfersa method or concept carried in from another field

The paper

The full text is not reproduced here. This article is not cleared for redistribution, so the page carries the tag layer only. Its evidence sentences are withheld; the grounding status remains with each tag, and the article itself is at https://jmlr.org/papers/v3/blei03a.html. The reading view exists for the papers whose licence permits it.

Every tag on this page

alternatives 3 · claim_relations 6 · claim_type 1 · concept_edges 3 · concepts 5 · content_tags 7 · controls 1 · limitations 6 · mechanisms 1 · method 1 · phenomenon 1 · senses 3 · transfers 1

Relations on this page carry a quotation for the claim. Where a relation was separately evidenced — and so tested against the vocabulary for its type — the row says so; 1 of 3 relations here carries that mark. The rest are the tagger’s reading of the sentence quoted beside them.

facettagfieldconf.whose words
claim_typemethod
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
claim_typethe paper's words
phenomenontopic modelling of document collections
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
phenomenonthe paper's words
methodsystem-or-tool-building
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
methodthe paper's words
mechanismsmechanisms
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
mechanisms[0]the tagger's words
limitationsThe bag-of-words (exchangeability) assumption can split words that belong to a single phrase across different topics.
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
what this limits: every topic assignment over multi-word names and phrases: THE BAG-OF-WORDS ASSUMPTION ALLOWS WORDS THAT SHOULD BE GENERATED BY THE SAME TOPIC (E.G., 'WILLIAM RANDOLPH HEARST FOUNDATION') TO BE ALLOCATED TO SEVERAL DIFFERENT TOPICS
limitations[0]the tagger's words
limitationsThe text-classification results are presented as preliminary and needing further support.
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
what this limits: the text-classification result: ALTHOUGH THESE RESULTS NEED FURTHER SUBSTANTIATION, THEY SUGGEST THAT THE TOPIC-BASED REPRESENTATION ... MAY BE USEFUL AS A FAST FILTERING ALGORITHM
limitations[1]the tagger's words
limitationsExact posterior inference in LDA cannot be done; only approximate inference is available.
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
what this limits: any topic solution treated as the posterior: EXACT INFERENCE IS INTRACTABLE FOR LDA, and only approximate inference algorithms are available
limitations[2]the tagger's words
limitationsThe authors disclaim any epistemological claim about the variables they call topics.
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
what this limits: any interpretation of a fitted topic as a theme or subject: the authors state they use the word topics to exploit text-oriented intuitions and make no epistemological claims about these latent variables beyond their utility in representing probability distributions on sets of words
limitations[3]1.0the tagger's words
limitationsThe text vocabulary is stated to be an aid to intuition, and the model is not tied to text.
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
what this limits: any humanities reading of this model's output: the authors state the language of text collections is used to guide intuition and that the LDA model is not necessarily tied to text
limitations[4]1.0the tagger's words
limitationsDocuments as well as words are assumed exchangeable, which the authors note is less often stated.
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
what this limits: any use of a topic model over a corpus with an order that matters, such as a diachronic study: the methods assume documents are exchangeable, so the specific ordering of documents in a corpus can be neglected, which the authors note is less often stated formally
limitations[5]1.0the tagger's words
transfersthe document-and-words structure of latent Dirichlet allocation carried over to collaborative filtering, with a user standing in for a document and the movies chosen standing in for its words
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
transfers[0]0.85the tagger's words
controlsdensity estimation evaluated by likelihood on a held-out test set, with the corpora treated as unlabelled
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
eliminates: a model rewarded for memorising the documents it was fitted to · outcome (stated by the tagger, no quotation): held
controls[0]0.85the tagger's words
conceptslatent multinomial variables
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
concepts[4]the paper's words
conceptsexchangeability
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
concepts[5]the paper's words
conceptsbag-of-words
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
also in: bag-of-words
concepts[6]the paper's words
conceptsperplexity
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
also in: perplexity
concepts[7]the paper's words
conceptstopic
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
also in: topic
concepts[8]the paper's words
sensesa topic - A LATENT MULTINOMIAL VARIABLE, NAMED TO BORROW A MEANING IT DOES NOT CLAIM: the authors say they call these variables topics in order to exploit text-oriented intuitions, and in the same sentence make no epistemological claims about them beyond representing probability distributions over words; the word appears about a hundred times in the body and the disclaimer once, in a footnote
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
senses[0]1.0the tagger's words
sensesthe language of text collections - A GUIDE TO INTUITION, NOT A DOMAIN: words, documents and corpora are used throughout because they help intuition, while the model itself is stated not to be necessarily tied to text and is applied to collaborative filtering and other collections
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
senses[1]1.0the tagger's words
sensesexchangeability - TWO ASSUMPTIONS, ONE OF THEM USUALLY LEFT UNSAID: words within a document are exchangeable, which is the bag-of-words assumption everyone states, and DOCUMENTS are exchangeable too, which the authors say is less often stated formally - the second is what removes time from a corpus
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
senses[2]1.0the tagger's words
alternativesclaim_type: method
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
a second reading reaching the same value. Recorded: method — note: A BLIND second reading by the project on 2026-08-25: the record's own claim type/method/phenomenon were not looked at until every value here was written and substring-verified. Not applied - a person decides. Sampling frame: the 504 staged records carrying no alternatives block, so this never re-measures the 202. All 11 records with 130+ tags were taken as a census and 19 more spread one per discipline across 22 disciplines - the dense non-neuroscience cell is the one the 202 do not contain (inside them, 94-100% of the densest bands are neuroscience; among these 11, one is).,
alternatives.claim_type0.9the tagger's words
alternativesmethod: probabilistic-modelling
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
a second reading DIFFERING from the recorded value. Recorded: system-or-tool-building — note: A BLIND second reading by the project on 2026-08-25: the record's own claim type/method/phenomenon were not looked at until every value here was written and substring-verified. Not applied - a person decides. Sampling frame: the 504 staged records carrying no alternatives block, so this never re-measures the 202. All 11 records with 130+ tags were taken as a census and 19 more spread one per discipline across 22 disciplines - the dense non-neuroscience cell is the one the 202 do not contain (inside them, 94-100% of the densest bands are neuroscience; among these 11, one is).,
alternatives.method0.75the tagger's words
alternativesphenomenon: latent topic structure in collections of discrete data such as text corpora
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
a second reading DIFFERING from the recorded value. Recorded: topic modelling of document collections — note: A BLIND second reading by the project on 2026-08-25: the record's own claim type/method/phenomenon were not looked at until every value here was written and substring-verified. Not applied - a person decides. Sampling frame: the 504 staged records carrying no alternatives block, so this never re-measures the 202. All 11 records with 130+ tags were taken as a census and 19 more spread one per discipline across 22 disciplines - the dense non-neuroscience cell is the one the 202 do not contain (inside them, 94-100% of the densest bands are neuroscience; among these 11, one is).,
alternatives.phenomenon0.9the tagger's words
claim_relationsbuilds-on → hierarchical Bayesian modeling
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
claim_relations[0]the tagger's words
claim_relationscontradicts → LSI (latent semantic indexing) methodology
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
claim_relations[1]the tagger's words
claim_relationsextends → Hofmann (1999) probabilistic latent semantic indexing (pLSI) model
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
claim_relations[2]the tagger's words
claim_relationscontradicts → Hofmann's pLSI treatment of documents
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
differs in: THE PARAMETER IS THE LEVEL AT WHICH THE MODEL IS PROBABILISTIC. The span: 'While Hofmann's work is a useful step toward probabilistic modeling of text, it is incomplete Quotation withheld.' The contradiction is not global - pLSI is granted as a useful step - and it turns on one named thing.
claim_relations[3]the tagger's words
claim_relationsbuilds-on → de Finetti (1990) representation theorem for exchangeable random variables
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
claim_relations[4]the tagger's words
claim_relationsbuilds-on → Nigam et al. (2000) mixture of unigrams model
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
claim_relations[5]the tagger's words
concept_edgestopic —operationalised-as→ latent multinomial variables
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
strength of the relation: 1
concept_edges[0]the tagger's words
concept_edgesbag-of-words —same-as→ exchangeability
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
strength of the relation: 1
concept_edges[1]the tagger's words
concept_edgesbag-of-words —renamed-across-fields→ exchangeability
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
the relation itself is separately evidenced · strength of the relation: 1 · note: ADDS the better-typed edge beside the record's 'same-as'. The same-as is defensible and is left alone; this one says WHY they are the same - it is one assumption renamed between fields. · the relation stated: ONE assumption under two field vocabularies - information retrieval calls it bag-of-words, probability theory calls it exchangeability
concept_edges[2]the tagger's words
content_tagsLDA is a generative probabilistic model for text corpora: a three-level hierarchical Bayesian model in which each item is a finite mixture over an underlying set of topics.
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
content_tags.findings[0]the tagger's words
content_tagsInference uses efficient approximate variational methods and an EM algorithm; results in document modeling, text classification and collaborative filtering are compared with a mixture-of-unigrams model and probabilistic LSI.
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
content_tags.findings[1]the tagger's words
content_tagslatent Dirichlet allocation (LDA)
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
content_tags.definitions[0]the tagger's words
content_tagstopic
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
also in: topic
content_tags.definitions[1]the tagger's words
content_tagstf-idf scheme
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
about this quote: QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted.
also in: tf-idf scheme
content_tags.definitions[2]the tagger's words
content_tagsBayesian
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
about this quote: QUOTE REPAIRED: the extractor split a unicode and the quote was recorded faithfully with the damage in it, which made it unanchorable. The repaired string is an EXACT SUBSTRING of the staged text - that is why it was accepted, not because a rule produced it. The text as originally recorded is kept in evidence as extracted.
also in: Bayesian
content_tags.statistics[0]the tagger's words
content_tagsmean
Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.
also in: mean
content_tags.statistics[1]the tagger's words

Interpretive choices

Tags that could not be placed in the text:

What was deliberately not tagged, and why, is recorded per paper by the tagger. Where a paper has no such record, this page says so rather than implying that nothing was declined.

© 2026 Shir Sivroni · ORCID 0009-0000-2597-2824