phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text| phenomenon | relevant information extraction under lossy compression— “A fundamental problem in formalizing our intuitive ideas about information is to provide a quantitative notion of “meaningful” or “relevant” information.” | |
| claim-type | method— “We derive self consistent equations and an iterative algorithm for finding representations of the signal that capture its relevant structure, and prove 3 convergence of this algorithm.” [checked against the archived source, not this rendering] | |
| method — evidence | — “To prove the convergence of the iterations it is enough to verify that each of the iteration steps minimizes the same functional, independently, and that this functional is bounded from below as a sum of two non–negative terms.” | |
| transfer | from rate distortion theory in communication: the rate-distortion trade-off curve and its cardinality specification, taken from lossy source coding and re-drawn in the information plane as the bottleneck curve— “These curves, analogous to the rate distortion curves, exists for every choice of the cardinality of ˜X.” | transfers[0] |
| mechanism | relevance is supplied by a SECOND VARIABLE with positive mutual information, in place of a chosen distortion function, and the joint distribution of the two is assumed available— “Since the “right” distortion measure is rarely available, the problem of relevant quantization has to be addressed directly, by preserving the relevant information about another variable. The relevance variable, denoted here by Y , must not be independent from the original signal X, namely they have positive mutual information I(X; Y ). It is… | mechanisms[0] |
| mechanism | one Lagrange multiplier carries the whole tradeoff, and its two limits are stated: at zero everything collapses to a single codeword, and as it grows the quantization becomes arbitrarily fine— “At β = 0 our quantization is the most sketchy possible—everything is assigned to a single point—while as β → ∞ we are pushed toward arbitrarily detailed quantization. By varying the (only) parameter β one can explore the tradeoffbetween the preserved meaningful information and compression at various resolutions.” | mechanisms[1] |
| mechanism | the Markov condition is stated NOT to be a modelling assumption - the compressed variable is not a hidden variable in a model of the data - and the paper names the different condition a model would have required instead— “It is important to notice that this not a modeling assumption and the quantization ˜X is not used as a hidden variable in a model of the data. In the latter, the Markov condition would have been different: Y ← ˜X ← X.” | mechanisms[2] |
| mechanism | the compressed representation and its representatives are solved for TOGETHER, which is what separates this from rate distortion theory, where choosing representatives is a separate problem— “The crucial quantization is here performed through the conditional distributions p(y|˜x), and the self consistent equations include also the optimization over the representatives, in contrast to rate distortion theory, where the selection of representatives is a separate problem.” | mechanisms[3] |
| mechanism | convergence of the alternating iterations is argued from each step minimising the same functional independently, that functional being bounded below as a sum of two non-negative terms that the alternation runs over THREE convex sets is stated in Theorem 5, a different span, not in this one— “To prove the convergence of the iterations it is enough to verify that each of the iteration steps minimizes the same functional, independently, and that this functional is bounded from below as a sum of two non–negative terms. The only point to notice is that when p(y|˜x) is fixed we are back to the rate distortion case with fixed distortion… | mechanisms[4] |
| mechanism | raising the multiplier traces convex curves in the information plane, and pairs of curves separate at a finite critical value through a second order phase transition, producing a hierarchy of quantizations | mechanisms[5] |
| extends | rate-distortion theory (Shannon) Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | claim_relations[0] |
| contradicts | the arbitrary choice of distortion function in rate-distortion theory Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | claim_relations[1] |
| extends | rate distortion theory Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | claim_relations[2] |
| extends | the Blahut–Arimoto algorithm Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | claim_relations[3] |
| builds-on | the convergence lemma of Csiszár and Tusnády Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | claim_relations[4] |
| sense | relevant information - DEFINED BY A CHOSEN SECOND VARIABLE: what a signal tells you about another signal Y, so relevance is never a property of the signal alone and the choice of Y fixes which features count Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | senses[0] |
| sense | relevance - AS SET BY THE ANALYST'S PURPOSE: the same speech signal has different relevant features depending on whether the task is recognition or speaker identification, and the paper lists the choice per domain Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | senses[1] |
| sense | meaning - WHAT SHANNON DELIBERATELY LEFT OUT: information theory was formulated about transmitting information rather than judging its value to the recipient, and this paper returns to the excluded question Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | senses[2] |
| sense | the distortion measure - EMERGENT, NOT ASSUMED: the KL divergence falls out of the variational principle rather than being chosen in advance, which is the paper's answer to the arbitrariness it identifies Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | senses[3] |
| audit | relevant information —operationalised-as→ distortion function — Audit 2026-09-28: DOUBTFUL - read against its full span and kept, but the span says the distortion function IMPLICITLY specifies the relevant aspects; operationalised-as is loose. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | concept_edges[0] |
| for which use | limitation — any claim that the method finds the solution: THUS OUR CONVERGENCE PROOF DOES NOT IMPLY UNIQUENESS OF THE SOLUTION Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[0] |
| for which use | limitation — the solution as something to compute with: IT IS A FORMAL SOLUTION SINCE p(y|x~) IN THE EXPONENTIAL IS DEFINED IMPLICITLY IN TERMS OF THE ASSIGNMENT MAPPING Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[1] |
| for which use | limitation — the claim that the method determines the representation: THE FORMAL SOLUTION ... STILL REQUIRES A SPECIFICATION OF THE STRUCTURE AND CARDINALITY OF X~, AS IN RATE DISTORTION THEORY Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[2] |
| for which use | limitation — every application to finite data: THE PROBLEM OF ACTUALLY OBTAINING A GOOD ENOUGH SAMPLE OF THIS DISTRIBUTION IS AN INTERESTING ISSUE IN LEARNING THEORY, BUT IS BEYOND THE SCOPE OF THIS PAPER Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[3] |
| for which use | limitation — the convergence result as a proved theorem in this paper: FOR LACK OF SPACE WE CAN ONLY OUTLINE THE PROOF Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[4] |
| for which use | limitation — any claim that a compressed representation keeps the relevant information: the problem is not well posed without a suitable definition of relevance, so the definition is supplied by the analyst before any result exists Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[5] |
| for which use | limitation — a rate-distortion result as a statement about which parts of a signal matter: the distortion function is an implicit feature selection, and the paper states it is virtually impossible to come up with the correct one for acoustic signals Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[6] |
| for which use | limitation — any single information-bottleneck solution: compression is traded against preserved meaningful information, there is no single right solution for that trade-off, and the balance is set by the Lagrange multiplier Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[7] |
| replication | untested | |
| limitation | The convergence proof does not establish that the solution is unique, since the functional is convex in each distribution separately but not jointly. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[0] |
| limitation | The solution is formal: the conditional distribution appearing in the exponent is defined only implicitly in terms of the mapping being solved for. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[1] |
| limitation | The structure and cardinality of the compressed representation still have to be specified externally and are not determined by the theory. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[2] |
| limitation | The method assumes access to the joint distribution; how to obtain an adequate sample of it is left outside the paper. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[3] |
| limitation | The convergence proof for the bottleneck iterations is only sketched in this paper for reasons of length. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[4] |
| limitation | The problem the paper addresses is stated to be ill-posed until someone supplies a definition of relevance, which is a choice and not a measurement. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[5] |
| limitation | Choosing the distortion function is choosing which features matter, and the paper says the correct one is virtually impossible to obtain for a real signal. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[6] |
| limitation | The trade-off the method exposes has no uniquely right setting; the balance point is a parameter the analyst turns. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | limitations[7] |
finding · quantity · variable · definition · key-term — grounded in the full text| finding | The information X gives about Y is squeezed through a bottleneck of codewords, a constrained optimization that generalizes rate-distortion theory with the distortion measure emerging from the joint statistics of X and Y. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.findings[0] |
| evidence status note | finding — QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted. | content_tags.findings[0] |
| finding | The method yields an exact set of self-consistent equations solvable by a convergent re-estimation generalizing the Blahut–Arimoto algorithm. Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.findings[1] |
| evidence status note | finding — QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted. | content_tags.findings[1] |
| variable | information about Y (dependent) Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.variables[1] |
| definition | relevant information Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.definitions[0] |
| evidence status note | definition — QUOTE REPAIRED: the extractor split a hyphen-space and the quote was recorded faithfully with the damage in it, which made it unanchorable. The repaired string is an EXACT SUBSTRING of the staged text - that is why it was accepted, not because a rule produced it. The text as originally recorded is kept in evidence as extracted. | content_tags.definitions[0] |
| definition | information bottleneck Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.definitions[1] |
| evidence status note | definition — QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted. | content_tags.definitions[1] |
| key-terms | information, signal, distortion, compression, bottleneck, rate, relevant, quantization |
| concept | mutual information Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | concepts[1] |
| concept | relevant information Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | concepts[4] |
| concept | distortion function Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | concepts[5] |
| concept | relevance variable Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | concepts[6] |
| concept | meaningful information Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | concepts[7] |
| Bayesian | as written: Bayes Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.statistics[0] |
| evidence status note | Bayesian — QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted. | content_tags.statistics[0] |
| mean μ | as written: average of Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.statistics[1] |
| evidence status note | mean — QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted. | content_tags.statistics[1] |
When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote for that row; on this page it is withheld with the article, and the article is at its publisher. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.
Tag layer © the Meta-Tagging Project, CC BY 4.0. The paper text is © its authors/publisher
and is linked, not reproduced. Excerpts shown are short quotations for identification and verification.
· back to index
· concepts · authors
· עברית
© 2026 Shir Sivroni · ORCID 0009-0000-2597-2824