| phenomenon | information flow in biological systems— “Life depends as much on the flow of information as on the flow of energy.” |
| claim-type | mechanism— “Many of these analyses are motivated by the idea that biological systems may have evolved to optimize the gathering and representation of information, and we review the experimental evidence for this optimization, again across a wide range of scales.” |
| method — evidence | — “Here we review the many efforts to make this intuition precise.” |
| transfer | from information theory (Shannon / communication theory): quantifying information processing in living systems using mutual information and entropy— “In 1948 Shannon asked whether we could attach a number to the amount of information we gain” | transfers[0] |
| mechanism | THE PAPER'S QUESTION IS WHETHER AN INTUITION CAN BE FORMALISED, AND IT IS ASKED IN THOSE WORDS: in all these cases INTUITION TELLS US that information is FLOWING from the environment to a representation internal to the organism - CAN THIS INTUITION BE FORMALIZED? IF SO, CAN IT BE CONNECTED, QUANTITATIVELY, TO EXPERIMENTAL DATA? The scare quotes on `flowing` are the paper's, and they mark exactly what has to be earned— “In all these cases, intuition tells us that information is “flowing” from the outside environment to a representation internal to the organism or a population, and that this information flow is essential for life. Can this intuition be formalized? If so, can it be connected, quantitatively, to experimental data? Most ambitiously, can a focus… | mechanisms[0] |
| mechanism | THE ABSTRACT VOCABULARY IS SHOWN TO BE NEEDED ONLY WHERE A CONCRETE ONE IS MISSING: in a ferromagnet what carries information over long distances is the ORDER PARAMETER - and PRECISELY BECAUSE WE CAN IDENTIFY THE ORDER PARAMETER, WE DON'T NEED TO SPEAK ABSTRACTLY ABOUT INFORMATION. Rather than turning CARRY INFORMATION into a precise mathematical statement, one just computes correlation functions. The general term is a substitute for a specific one that is absent— “When we look a ferromagnet, for example, we know that all the details of the electronic configurations on one side of the sample are not relevant if we try to predict those on the other side of the sample; what does carry information across long distances is the order parameter, in this case the magnetization. But precisely because we can… | mechanisms[1] |
| mechanism | AND THE CONDITIONS UNDER WHICH THE ABSTRACT VOCABULARY BECOMES NECESSARY ARE SPELLED OUT: for most biological systems finding something like an order parameter REMAINS A DISTANT HOPE, SYMMETRIES ARE ABSENT, and EVEN LOCALITY IS NOT MUCH OF A GUIDE - UNDER THESE CONDITIONS, some MORE GENERAL APPROACHES to formalizing the intuition WOULD BE USEFUL. The need for the general term is derived from three specific things the field does not have— “For most of the biological systems that we will be discussing, finding something like an order parameter remains a distant hope. Symmetries are absent, and even locality is not much of a guide to understanding, for example, a network of neurons in which each cell may be connected to many thousands of neighbors. Under these conditions, some… | mechanisms[2] |
| mechanism | A DISCIPLINARY TRADITION IS NAMED AS THE REASON FOR A TRADE-OFF, AND THE COST IS STATED IN THE SAME SENTENCE: THROUGHOUT, WE FOLLOW THE PHYSICS TRADITION OF EMPHASIZING THE UNITY OF THEORETICAL IDEAS AT THE EXPENSE OF SOME OF THE BIOLOGICAL COMPLEXITY. What is being traded, and on whose authority, are both on the page— “Throughout, we follow the physics tradition of emphasizing the unity of theoretical ideas at the expense of some of the biological complexity.” | mechanisms[3] |
| mechanism | WHICH PARTS OF A TRANSFERRED FORMALISM ARE USEFUL DEPENDS ON THE DESTINATION FIELD, AND THE MISMATCH IS STATED: the ideas MOST WIDELY USED in thinking about biological systems are NOT NECESSARILY THOSE THAT HAVE BEEN MOST USEFUL in the enormously successful application of information theory to communication technology - SO OUR PERSPECTIVE HERE IS SOMEWHAT DIFFERENT from the standard text's— “Ideas which have been most widely used in thinking about biological systems are not necessarily those that have been most useful in the (enormously successful) application of information theory to communication technology, so our perspective here is somewhat different from that in Ref [3].” | mechanisms[4] |
| mechanism | THE MEASURE IS FORCED BY POSTULATES RATHER THAN CHOSEN, AND THE POSTULATES ARE LISTED FIRST: ANY ACCEPTABLE MEASURE OF INFORMATION MUST OBEY SOME CONSTRAINTS - it must grow with the number of equally likely answers; it must ADD across independent parts; and it must be the weighted sum along the paths of a tree of choices - and REMARKABLY, THESE POSTULATES ALLOW ONLY ONE POSSIBLE MEASURE OF INFORMATION, THE ENTROPY. A definition derived from desiderata, not stipulated— “Any acceptable measure of information must obey some constraints: if all N possible answers are equally likely, then the information must grow with N ; if the question can be decomposed into independent parts, then the information gained on hearing the answer to each part should add to the total; if we can decompose the full question into a… | mechanisms[5] |
| mechanism | TWO SEEMINGLY DIFFERENT QUESTIONS TURN OUT TO HAVE THE SAME ANSWER, WHICH IS WHAT LICENSES ONE WORD FOR BOTH: A SEEMINGLY VERY DIFFERENT QUESTION concerns the amount of SPACE required to write down the answer - and THE ANSWER IS AGAIN THE ENTROPY. One formal object serving as the answer to a question about knowledge and to a question about storage— “A seemingly very different question concerns the amount of space required to write down, or represent the answer to our question. While each possible answer might require a different amount of space, if this is a question we can ask many times (what will the temperature be at noon tomorrow?) then it makes sense to ask about the minimum amount… | mechanisms[6] |
| mechanism | AN AMBIGUITY IN THE UNITS IS NAMED, RESOLVED BY CONVENTION, AND THE NAME IS ATTACHED TO THE CONVENTION: THERE IS SOME AMBIGUITY ABOUT UNITS - the alphabet is a choice and the constant is arbitrary - BUT if a binary alphabet is chosen and the constant set to one, ALL OF THE AMBIGUITY IS RESOLVED, and measured in these units they ARE CALLED BITS. The familiar name names a settled convention, not a quantity— “There is some ambiguity about units—the number of characters we need to write the answer depends on our choice of alphabet, and the entropy itself has an arbitrary constant k—but if we choose, for example, a binary alphabet, we can set k = 1 and log log2, then all of the ambiguity is resolved. When entropy or information is measured in these… | mechanisms[7] |
| mechanism | THE SAME QUANTITY IS GIVEN TWO DESCRIPTIONS OF OPPOSITE VALENCE AND ONE IS PREFERRED: Shannon's theorem MAKES PRECISE THE VAGUE STATEMENT made in many statistical mechanics classes, that entropy is related to our LACK of information about the microscopic state - and THE MORE POSITIVE VERSION IS THAT THE ENTROPY IS THE INFORMATION WE WOULD GAIN upon learning the full state. One object, a lack and a gain, and the author says which framing he prefers— “Shannon’s theorem makes precise the vague statement made in many statistical mechanics classes, that entropy is related to our lack of information about the microscopic state of a system. The more positive version is that the entropy is the information we would gain upon learning the full microscopic state.” | mechanisms[8] |
| mechanism | A PREDICTION IS RATED BY WHAT IT DID NOT NEED RATHER THAN BY HOW WELL IT FIT: the measured input/output relation agreed REMARKABLY with the theory, ESPECIALLY CONSIDERING THAT THERE ARE NO FREE PARAMETERS - and the result is credited with having INSPIRED THE COMMUNITY TO TAKE THESE IDEAS MORE SERIOUSLY. The absence of adjustable quantities is what the agreement is worth— “By sampling natural scenes with a custom-built photodetector to predict the optimal input/output relation and comparing it with the measured one, Laughlin found a remarkable agreement with the theory, especially considering that there are no free parameters. Although there are obvious open questions, this was a really beautiful result that… | mechanisms[9] |
| builds-on | Shannon information theory (1948)— “In 1948 Shannon asked whether we could attach a number to the amount of information we gain” | claim_relations[0] |
| sense | a bit - NOT A UNIT OF VALUE: the universality of information-theoretic quantities is called their strength, and in the same breath the authors note that bits may not be of equal value or utility to the organism, so a count of bits is silent about which of them the animal needed— “The universality of information-theoretic quantities is their strength, but it also leaves one with an uncomfortable feeling that there is more to the story of biological signal processing than bits. In particular, not all bits may be of equal value or utility to the organism” | senses[0] |
| sense | information - AS A DELIBERATELY CONTENT-FREE MEASURE: chosen because the relevant features and the biologically meaningful metric may both be unknown, so generality is the reason for the choice rather than a side effect of it— “In complex systems, we may be unsure which features of the system dynamics are the most relevant. Even if we can identify the correct features, we might not know the biologically meaningful metric that measures the similarity or difference along these relevant dimensions. Information theory gives us a way out of these difficulties, because it… | senses[1] |
| sense | meaning - CLAIMED ONLY BY NOT QUITE CLAIMING IT: an information-theoretic clustering produces semantic rather than merely syntactic coherence and the authors say it is hard to resist saying the approach extracts meaning, which leaves the assertion unmade while the reader makes it— “The resulting clusters exhibit a striking degree of semantic (rather than just syntactic) coherence, and it hard to resist saying that this purely information theoretic approach is extracting meaning” | senses[2] |
| audit | mutual information —distinct-from→ utility — Audit 2026-09-28: DOUBTFUL - read against its full span and kept, but the span says not all bits MAY be of equal value or utility; hedged.— “The universality of information-theoretic quantities is their strength, but it also leaves one with an uncomfortable feeling that there is more to the story of biological signal processing than bits. In particular, not all bits may be of equal value or utility to the organism” | concept_edges[0] |
| for which use | limitation — the level of biological detail in every claim: WE FOLLOW THE PHYSICS TRADITION OF EMPHASIZING THE UNITY OF THEORETICAL IDEAS AT THE EXPENSE OF SOME OF THE BIOLOGICAL COMPLEXITY— “Throughout, we follow the physics tradition of emphasizing the unity of theoretical ideas at the expense of some of the biological complexity.” | limitations[0] |
| for which use | limitation — every entropy or mutual-information estimate: THE DIFFICULTY OF ACTUALLY ESTIMATING THE ENTROPY OF A PROBABILITY DISTRIBUTION FROM A LIMITED SET OF SAMPLES— “Against this generality is the difficulty of actually estimating the entropy of a probability distribution from a limited set of samples.” | limitations[1] |
| for which use | limitation — the sufficiency of the information-theoretic framing itself: ITS UNIVERSALITY IS ITS STRENGTH, BUT IT ALSO LEAVES ONE WITH AN UNCOMFORTABLE FEELING THAT THERE IS MORE TO THE STORY - not all bits are equal— “The universality of information-theoretic quantities is their strength, but it also leaves one with an uncomfortable feeling that there is more to the story of biological signal processing than bits.” | limitations[2] |
| for which use | limitation — the maximum-entropy protein-folding results: THERE ARE MANY OPEN QUESTIONS ABOUT THE SUFFICIENCY OF THE AVAILABLE DATA AND THE APPROXIMATIONS— “This new approach to the protein folding problem has generated considerable excitement, but there are many open questions about the sufficiency of the available data and the approximations that have been used to solve the inverse problem.” | limitations[3] |
| for which use | limitation — the scope of the review: the links to statistical mechanics and field theory ARE BEYOND THE SCOPE OF THIS REVIEW— “There are many interesting links between the learning problem, statistical mechanics, and field theory, which are beyond the scope of this review.” | limitations[4] |
| for which use | limitation — the scope of information-theoretic claims about biology: the authors suggest it is not widely appreciated what the theory does and does not cover, perhaps because Shannon titled his work a mathematical theory of communication— “Perhaps because Shannon called his work a mathematical theory of communication, it is not as widely appreciated” | limitations[5] |
| for which use | limitation — the use of information-theoretic measures here: they are adopted because one may be unsure which features are most relevant and may not know the biologically meaningful metric, and these measures are completely general— “In complex systems, we may be unsure which features of the system dynamics are the most relevant. Even if we can identify the correct features, we might not know the biologically meaningful metric that measures the similarity or difference along these relevant dimensions. Information theory gives us a way out of these difficulties, because it… | limitations[6] |
| for which use | limitation — the claim that information-theoretic clustering recovers meaning: the authors write that it is hard to resist saying so, which reports the temptation rather than making the claim— “The resulting clusters exhibit a striking degree of semantic (rather than just syntactic) coherence, and it hard to resist saying that this purely information theoretic approach is extracting meaning” | limitations[7] |
| evidence status note | mechanism — EXTENDED: the first cut stopped four words short of "the entropy" - the answer the tag is about. Widening rather than weakening. The span ends on a comma because the next token is a footnote marker glued to a displayed formula ("answers,1 S[p] =").— “Any acceptable measure of information must obey some constraints: if all N possible answers are equally likely, then the information must grow with N ; if the question can be decomposed into independent parts, then the information gained on hearing the answer to each part should add to the total; if we can decompose the full question into a… | mechanisms[5] |
| evidence status note | mechanism — EXTENDED BACKWARDS so the span carries the method as well as the verdict. NOTE ON HOW THIS NEARLY WENT WRONG: my first attempt at the start key was "By MEASURING natural scenes" and the paper says "By SAMPLING natural scenes". I typed the verb from memory instead of slicing it, the uniqueness assertion caught it, and the correct word came from the file. Slice, never type - including the words you are certain of.— “By sampling natural scenes with a custom-built photodetector to predict the optimal input/output relation and comparing it with the measured one, Laughlin found a remarkable agreement with the theory, especially considering that there are no free parameters. Although there are obvious open questions, this was a really beautiful result that… | mechanisms[9] |
| replication | untested |
| no type for this | adaptation → nonlinear transient response — NO BOUNDARY CAN BE DRAWN - the CONCEPTUAL form of the negative relation / This is a claim about the concepts themselves, not about this study's data. No edge type can express it: all eight assert that a relation HOLDS. The boundary fails because of a TIMESCALE - the response adjusts so fast that the two cannot be told apart - so the distinction is real in principle and unusable in practice.— “When the input distribution shifts suddenly, the input/output relation adjusts with remarkable speed, perhaps so rapidly that there is no sharp distinction between adaptation and the nonlinear transient response.” | unhoused_relations[0] |
| no type for this | Shannon’s theorem → the vague statement that entropy is related to our lack of information — THREE PAPERS, THREE DIFFERENT VERDICTS ON WHETHER A FORMALISM CAN BE SHOWN TO CAPTURE THE INFORMAL NOTION IT REPLACES - and no type in the vocabulary can express a disagreement about what KIND OF CLAIM something is. This paper reports that a theorem DID make a vague statement precise - the one made in many statistical mechanics classes - and then states the more positive version of it. turing1936-computable-numbers argues the identification rather than proving it; shor1997-factoring says making it a theorem would weaken it. 'same-as' and 'distinct-from' are both false here: the three are not making one claim or two, they are ruling differently on whether the identification is the sort of thing a proof can settle. All eight edge types assert that a relation holds between two concepts. Recorded per record, each row quoting only its own paper; the cross-paper half is this paraphrase, checkable by opening the other two., and the third case for an earlier note of ours - which by the rule that one is an observation and three make a proposal is the point at which the gap should be put to Shir.— “Shannon’s theorem makes precise the vague statement made in many statistical mechanics classes, that entropy is related to our lack of information about the microscopic state of a system. The more positive version is that the entropy is the information we would gain upon learning the full microscopic state.” | unhoused_relations[1] |
| limitation | The review deliberately favours theoretical unity over biological detail.— “Throughout, we follow the physics tradition of emphasizing the unity of theoretical ideas at the expense of some of the biological complexity.” | limitations[0] |
| limitation | Entropy and mutual information are hard to estimate from finite samples, which limits the whole programme.— “Against this generality is the difficulty of actually estimating the entropy of a probability distribution from a limited set of samples.” | limitations[1] |
| limitation | Information-theoretic quantities may not capture everything that matters biologically, since not all bits are equally useful to an organism.— “The universality of information-theoretic quantities is their strength, but it also leaves one with an uncomfortable feeling that there is more to the story of biological signal processing than bits.” | limitations[2] |
| limitation | The maximum-entropy approach to protein folding rests on data sufficiency and approximations that remain open questions.— “This new approach to the protein folding problem has generated considerable excitement, but there are many open questions about the sufficiency of the available data and the approximations that have been used to solve the inverse problem.” | limitations[3] |
| limitation | The connection between learning, statistical mechanics and field theory is explicitly out of scope.— “There are many interesting links between the learning problem, statistical mechanics, and field theory, which are beyond the scope of this review.” | limitations[4] |
| limitation | The under-appreciation of the theory's limits is attributed to the title of the paper that founded it.— “Perhaps because Shannon called his work a mathematical theory of communication, it is not as widely appreciated” | limitations[5] |
| limitation | The method is chosen precisely because it does not require knowing what matters.— “In complex systems, we may be unsure which features of the system dynamics are the most relevant. Even if we can identify the correct features, we might not know the biologically meaningful metric that measures the similarity or difference along these relevant dimensions. Information theory gives us a way out of these difficulties, because it… | limitations[6] |
| limitation | The strongest semantic claim in the review is made in a form that declines to assert it.— “The resulting clusters exhibit a striking degree of semantic (rather than just syntactic) coherence, and it hard to resist saying that this purely information theoretic approach is extracting meaning” | limitations[7] |