Analysis of 100,000 human cancer genomes reveals the landscape of tumor mutational burden — TEI-tagged view

Zachary R. Chalmers, Caitlin Connelly, David Fabrizio, Laurie M. Gay, Siraj M. Ali, Riley Ennis, Alexa B. Schrock, Brittany Campbell, Adam Shlien, Juliann Chmielecki, Franklin W. Huang, Yuting He, James Sun, Uri Tabori, Mark Kennedy, Daniel S. Lieber, Steven Roels, Jared White, Geoffrey A. Otto, Jeffrey S. Ross, Levi A. Garraway, Vincent A. Miller, P. J. Stephens, Garrett M. Frampton · 2017 · medicine · doi:10.1186/s13073-017-0424-2 · TEI xml · tagged edition · index · concepts · authors
Where this record's text came from. 2026-08-21 schema-0.3 pass: every quote verified as an exact substring of the staged text and anchored at merge time; concept terms verified present; every edge endpoint an existing node.
Other fields define these differently the same word, defined another way in another discipline
false discovery rate 6 fields · biomarker 2 fields
Tags on this paper every tag the record carries, whether or not the words occur in the text below — a number is how many papers in the corpus carry that tag; a tag with no number is unique to this paper
TMB mutation load biomarker5 Synonymous mutations MSI-High MSI score CGP WES neoantigens percentage deviation germline polymorphisms effect size35 omics-profiling19
Method, as described: targeted comprehensive genomic profiling of 315 genes with germline filtering and no matched normal, validated against matched whole exome sequencing and against in-silico subsetting of TCGA exomes

Our tag layer for this paper

Cross-disciplinary analysis
content-tags & facets: phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text
phenomenona clinical category - high mutational burden - whose membership depends on an assay's size, a list of exclusions, and a threshold stated once in a figure caption— “Specimens with TMB low and called as MSI-Stable are shown in light grey, specimens with high TMB (mutations/Mb >20) are shown in blue, and specimens called as MSI-High are shown in dark grey.”
claim-typeexistence— “We found that microsatellite instability (MSI-High) generally occurred as a subset of high TMB (Fig. 3a). The vast majority of MSI-High samples also had high TMB (83%), and 97% had TMB ≥10 mutations/Mb. However, the converse was not true; only 16% of samples with high TMB were classified as MSI-High.”
method — evidence— “For the WES samples, tumor and normal tissue were each sequenced in order to distinguish germline polymorphisms from somatic mutations. For the targeted CGP samples, no matched normal material was sequenced; rather, genomic variants were stringently filtered to eliminate germline polymorphisms (see “Methods” for details).”
object of study — evidence— “An emerging biomarker for response to immunotherapy is the total number of mutations present in a tumor specimen. This is termed the mutation load or tumor mutational burden (TMB). It is hypothesized that highly mutated tumors are more likely to harbor neoantigens which make them targets of activated immune cells.”
research question — evidence— “We finally sought to determine the effects of sequencing different amounts of the genome and how that might affect our ability to accurately determine TMB. We sampled the number of mutations that we would expect to see at different TMB levels (100 mutations/Mb, 20 mutations/Mb, 10 mutations/Mb) and at different amounts of megabases sequenced…
contribution — evidence— “We found that, as expected, the percentage deviation is lower for high underlying TMB, meaning that specimens with high TMB can be effectively identified by targeted sequencing of several hundred genes. In contrast, for intermediate levels of TMB, the percentage deviation starts to increase, especially with less than 0.5 Mb sequenced (Fig.…
transferfrom statistics: principal components analysis, carried from multivariate statistics to collapse 228 repeat-length measurements into a single MSI score that can be cut into categories— “To determine MSI status, 114 intronic homopolymer repeat loci with adequate coverage on the CGP panel were analyzed for length variability and compiled into an overall MSI score via principal components analysis. The 114 loci were selected from a total set of 1897 that have adequate coverage on the FMI FoundationOne bait set. Amongst the…transfers[0]
transferfrom survey sampling: resampling simulation, carried from survey methodology to ask how small a genomic panel may be before the rate it estimates stops being the rate— “We finally sought to determine the effects of sequencing different amounts of the genome and how that might affect our ability to accurately determine TMB. We sampled the number of mutations that we would expect to see at different TMB levels (100 mutations/Mb, 20 mutations/Mb, 10 mutations/Mb) and at different amounts of megabases sequenced…transfers[1]
mechanismsampling variance rising as the panel shrinks TMB is a rate estimated from a sample of the genome, so the fewer megabases read the noisier the estimate; the effect is worst where the underlying rate is low, because the expected count in the sampled region approaches zero— “We found that, as expected, the percentage deviation is lower for high underlying TMB, meaning that specimens with high TMB can be effectively identified by targeted sequencing of several hundred genes. In contrast, for intermediate levels of TMB, the percentage deviation starts to increase, especially with less than 0.5 Mb sequenced (Fig.…mechanisms[0]
mechanismsynonymous mutations as a process signal a synonymous change cannot itself create a neoantigen, but it is produced by the same mutational process that produced the nonsynonymous ones elsewhere, so counting it raises the sample size of the rate estimate without changing what the rate is about— “Synonymous mutations are counted in order to reduce sampling noise. While synonymous mutations are not likely to be directly involved in creating immunogenicity, their presence is a signal of mutational processes that will also have resulted in nonsynonymous mutations and neoantigens elsewhere in the genome.”mechanisms[1]
mechanismgermline filtering without a matched normal with no normal tissue sequenced, inherited variants must be removed by matching against reference databases - so the filter's accuracy is the databases' coverage of the patient's ancestry— “We found that filtering out germline alterations and rare variants was important to obtaining accurate measurements of TMB, and this will especially be important in patients from ethnic backgrounds not well represented in sequencing datasets.”mechanisms[2]
qualifies PD-1/PD-L1 expression by immunohistochemistry as the companion diagnostic for checkpoint inhibitors— “Assays that measure PD-1/PD-L1 protein expression by immunohistochemistry (IHC) are approved as complementary or companion diagnostics for some of these drugs; however, measurement of PD-1/PD-L1 expression is technically challenging, can be difficult to interpret, and is not always an accurate predictor of response to immunotherapy.”claim_relations[0]
extends whole exome measurement of tumour mutational burden, by showing a 1.1 Mb targeted panel reproduces it— “We also analyzed whole-exome sequencing data from 35 studies, published as part of TCGA, examining a total of 8917 cancer specimens. We determined the number of mutations in total and compared that to the number of mutations in the 315 genes targeted by our assay. As expected, these…claim_relations[1]
qualifies neoantigen load as the predictor of immunotherapy response - correlated, but with no recurrent neoantigens found that predict responseclaim_relations[2]
sense"high TMB" - AS USED throughout the abstract, results, discussion and conclusions: an unquantified clinical category of patients who might benefit from immunotherapy
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
senses[0]
sense"high TMB" - AS DEFINED: more than 20 mutations per megabase. The threshold appears once in the paper, in the caption of Fig. 3, and nowhere in the prose
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
senses[1]
senseagreement of targeted CGP with whole exome - AS ACCURACY: R2 = 0.74, from 29 specimens where both measurements were made on the same biopsy
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
senses[2]
senseagreement of targeted CGP with whole exome - AS PRECISION: R2 = 0.98, the assay against itself on 60 replicate pairs. The paper labels this one precision, and it is the number that looks like agreement without being it
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
senses[3]
controlthe same biopsy specimens measured by both the targeted panel and whole exome sequencing, so the panel is checked against a different measurement rather than against itself — partial
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
— rules out the targeted panel's own gene selection as the explanation of the burden it reports - the same biopsy measured by a method that selects no genes gives a correlated answer
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[0]
control60 replicate pairs run through the same assay, separating precision from accuracy — held
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
— rules out assay noise as the explanation of the remaining disagreement with whole exome sequencing - the assay repeats itself at R2 0.98, so what is left is between methods and not within one
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[1]
controlsimulating the measurement at smaller panel sizes to find where sampling variance makes the estimate unusable, rather than asserting that 1.1 Mb is enough — partial
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
— rules out sampling variance as a hidden contributor at the panel size actually used - the simulation measures it rather than assuming 1.1 Mb is enough, and names where it stops being enough
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[2]
controlan independent check on 8,917 TCGA exomes, comparing total mutations against those in the 315 assay genes — held
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
— rules out this laboratory's own cohort and pipeline as the source of the agreement - the same comparison on 8,917 independently generated exomes reproduces it
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[3]
controlcohort filtering declared in advance - duplicates removed, coverage floor, and a minimum of 50 specimens before a cancer type is analysed at all — held
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
— rules out duplicate specimens and under-covered samples as contributors to the reported distribution
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[4]
controlchecking whether more than the first principal component of the MSI score was needed — held
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
— rules out further principal components as carriers of microsatellite signal the one-dimensional score discards - none of the others explains more than 4% of the variance
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[5]
weightPD-1/PD-L1 expression by immunohistochemistry as the companion diagnostic for checkpoint inhibitors — 0.9
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
claim_relations[0]
weightwhole exome measurement of tumour mutational burden, by showing a 1.1 Mb targeted panel reproduces it — 0.9
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
claim_relations[1]
weightneoantigen load as the predictor of immunotherapy response - correlated, but with no recurrent neoantigens found that predict response — 0.85
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
claim_relations[2]
relationMSI-High —part-of→ TMB — MSI-High samples are largely a subset of the high-TMB population, and not the reverse
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concept_edges[0]
weightMSI-High —part-of→ TMB — 0.85
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concept_edges[0]
relationmutation load —same-as→ TMB — one quantity under two names, given in apposition at first use
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concept_edges[1]
weightmutation load —same-as→ TMB — 0.9
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concept_edges[1]
outcomecontrol — partial
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[0]
outcomecontrol — held
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[1]
outcomecontrol — partial
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[2]
outcomecontrol — held
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[3]
outcomecontrol — held
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[4]
outcomecontrol — held
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
controls[5]
limitationthe germline filter depends on reference databases, so it will be least accurate for patients from ethnic backgrounds not well represented in them - stated by the authors
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[0]
limitationthe MSI cut points were set by manual unsupervised clustering against a reference that was itself partly APPROXIMATED by the same pipeline's homopolymer indel counts
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[1]
limitationthe accuracy figure rests on 29 specimens with matched whole exome sequencing; the two 0.98 correlations are the assay against itself and an in-silico subsetting
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[2]
limitationknown mismatch-repair and replication genes account for less than 10% of high-TMB cases, so the molecular basis of most of the phenomenon is unexplained
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[3]
limitationthe PMS2 promoter mutations are not shown to be causal, and the TOP2A association rests on eight cases
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[4]
limitationtargeted profiling measures the burden but cannot identify the neoantigens the mechanism depends on, since those may occur in any gene
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
limitations[5]
Content tags
content-observations: finding · quantity · variable · definition · key-term — grounded in the full text
finding
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.findings[0]
finding
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.findings[1]
finding
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.findings[2]
finding
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.findings[3]
quantitythe panel size below which measurement variance increases significantly
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.quantities[0]
quantityMSI-High samples that also had high TMB
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.quantities[1]
quantityhigh-TMB samples classified as MSI-High - the converse, and much smaller
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.quantities[2]
quantitythe initial clinical cohort, filtered to 92,439
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.quantities[3]
variablepercentage deviation
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.variables[0]
definitionTMB
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.definitions[0]
definitionhigh TMB
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.definitions[1]
definitionMSI score
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.definitions[2]
Concepts
terms this paper carries, each with the sentence it was cut from — the layer that joins one paper to another. Terms with no quote yet are on CONCEPTS.html.
conceptTMB — not defined in this paper's own words; somatic, coding, base substitution and indel mutations per megabase of genome examined - a count defined mostly by its seven exclusions
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[0]
conceptmutation load — not defined in this paper's own words; the other name for TMB, given in apposition at first use and then not used again
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[1]
conceptbiomarker — not defined in this paper's own words; a measurable stand-in for who will respond to immune checkpoint blockade; TMB is offered as one because the incumbent, PD-L1 by IHC, is not always an accurate predictor
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[2]
conceptSynonymous mutations — not defined in this paper's own words; counted although not themselves immunogenic, because their presence signals the mutational process that produced neoantigens elsewhere - an inclusion the authors stop to justify
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[3]
conceptMSI-High — not defined in this paper's own words; microsatellite instability high - a second marker of genomic instability, mostly a subset of high TMB but not the reverse
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[4]
conceptMSI score — not defined in this paper's own words; the first principal component of 114 homopolymer loci, cut into MSI-High / ambiguous / stable by manual unsupervised clustering
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[5]
conceptCGP — not defined in this paper's own words; comprehensive genomic profiling - the 315-gene, 1.1 Mb targeted assay, run without matched normal tissue and relying on filtering to remove germline variants
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[6]
conceptWES — not defined in this paper's own words; whole exome sequencing with matched tumour and normal tissue - the reference the targeted panel has to stand in for
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[7]
conceptneoantigens — not defined in this paper's own words; the mechanism by which mutation count is supposed to matter, and the thing TMB is a proxy for rather than a measurement of
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[8]
conceptpercentage deviation — not defined in this paper's own words; how far a downsampled measurement lands from the whole-exome answer - the quantity that decides how small a panel may be
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[9]
conceptgermline polymorphisms — not defined in this paper's own words; what must be removed without a matched normal sample, by filtering alone - and the filtering matters most for patients underrepresented in the reference databases
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[10]
concepteffect size — not defined in this paper's own words; the factor loading in the log-TMB model, cut at 0.5 - a chosen threshold equal to a 3.1-fold increase over wild-type
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
concepts[11]
Statistics — cross-field join keys
field-invariant statistical terms, used in their statistical sense (gated on a number / symbol / test). A p-value or a standard deviation means the SAME thing in physics, biology, psychology and sociology — so these are the strongest cross-field join keys. Grounded verbatim.
R2 = 0.74
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.statistics[0]
R2 = 0.98
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.statistics[1]
principal components analysis
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.statistics[2]
false discovery rate
Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher.
content_tags.statistics[3]

When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote for that row; on this page it is withheld with the article, and the article is at its publisher. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.

Tag layer © the Meta-Tagging Project, CC BY 4.0. The paper text is © its authors/publisher and is linked, not reproduced. Excerpts shown are short quotations for identification and verification. · back to index · concepts · authors · עברית
© 2026 Shir Sivroni · ORCID 0009-0000-2597-2824