The circuit architecture of cortical multisensory processing: Distinct functions jointly operating within a common anatomical network

The circuit architecture of cortical multisensory processing: Distinct functions jointly operating within a common anatomical network Meijer Mertens Pennartz Olcese Lansink

Tag layer of the DHSS Meta-Tagging Project. The article text is reproduced from the staged copy named in sourceDesc and is not altered; the tags are held separately in standOff so that overlapping and nested spans are preserved.

The circuit architecture of cortical multisensory processing: Distinct functions jointly operating within a common anatomical network 2019 Progress in Neurobiology 10.1016/j.pneurobio.2019.01.004 meijer2019-the-circuit-architecture-of-cortic meijer2019-the-circuit-architecture-of-cortic.txt, the project's staged copy 5c639c11bd3ce7dd3b3485e2add8ee730d113155 open-access neuroscience

the paper's own words

the tag layer; a sentence written by the tagger about the paper, always anchored to a quotation but not itself a quotation

0 spans located by searching the stored text for the quote's exact words, allowing any whitespace between them mechanism Quotation withheld because this record is not cleared for redistribution. cortical multisensory processing Quotation withheld because this record is not cleared for redistribution. review review Quotation withheld because this record is not cleared for redistribution. mechanisms sensory noise is independent across sense organs but shared within one modality, so pooling across modalities cancels more noise and yields a bigger behavioral gain than pooling within a modality Quotation withheld because this record is not cleared for redistribution. mechanisms sound enhances vision by disinhibition: A1 layer-5 axons drive layer-1 interneurons in V1, which inhibit the layer 2-3 interneurons that normally suppress pyramidal cells Quotation withheld because this record is not cleared for redistribution. mechanisms a cross-modal stimulus resets ongoing oscillations, imposing a cycle of high and low excitability so that later same-modality inputs are amplified or depressed according to oscillation phase Quotation withheld because this record is not cleared for redistribution. mechanisms prefrontal input to the thalamic reticular formation sets thalamic sensory gain, gating how much of each modality reaches primary cortex and thereby implementing sensory selection Quotation withheld because this record is not cleared for redistribution. mechanisms selecting neurons at the low tail of a normal response distribution guarantees they drift upward on remeasurement, manufacturing an apparent inverse-effectiveness effect out of nothing Quotation withheld because this record is not cleared for redistribution. mechanisms a loud auditory distractor overshadows a concurrent visual cue, capturing processing resources and cutting the behavioral response to the visual stimulus Quotation withheld because this record is not cleared for redistribution. The inventory of micro-circuits supporting multisensory processing is still incomplete and ambiguous. what this limits: the circuit inventory the review assembles: THE PICTURE OF AVAILABLE MICRO-CIRCUITRIES STARTS EMERGING FROM RECENT RESEARCH BUT IS FAR FROM BEING UNAMBIGUOUS AND COMPLETE Quotation withheld because this record is not cleared for redistribution. It is not yet known whether the mechanisms reviewed are specific to association or sensory cortex or are general coding schemes. what this limits: the level of generality of every mechanism reviewed: WHETHER SPECIFIC MECHANISMS PERTAIN TO ASSOCIATION CORTEX, SENSORY CORTEX, OR REPRESENT MORE GENERAL CODING SCHEMES AWAITS FURTHER INVESTIGATION Quotation withheld because this record is not cleared for redistribution. Whether the specific A1-V1 circuit implementations fit a general mechanism or a hierarchical Bayesian model is unresolved. what this limits: the hierarchical-Bayesian framing: WHETHER SUCH SPECIFIC CIRCUIT IMPLEMENTATIONS ARE COMPATIBLE WITH A GENERAL MECHANISM FOR MP, AND CAN BE MODELED IN A HIERARCHICAL BAYESIAN FASHION ... REMAINS TO BE ADDRESSED Quotation withheld because this record is not cleared for redistribution. The model's reliability prediction is stated by the authors to hold by definition. what this limits: any claim that MLE integration was confirmed to improve reliability: under the MLE rule the combined estimate's reliability is the sum of the unisensory reliabilities and is therefore by definition more reliable Quotation withheld because this record is not cleared for redistribution. The review adopts a deliberately broad definition and names what it thereby encompasses. what this limits: any count or comparison of multisensory findings under this review: the definition used is any process in which information across sensory modalities is combined to make a perceptual inference, which encompasses functions that both precede and incorporate cue integration Quotation withheld because this record is not cleared for redistribution. The species scope has an escape clause based on a judgement of standing. what this limits: the evidence base of this review: studies in cats and non-human primates are included if no rodent data are available or if the results have been seminal to the field Quotation withheld because this record is not cleared for redistribution. the observed correlation was tested against a NULL DISTRIBUTION built for the purpose eliminates: REGRESSION TO THE MEAN - that a correlation between unisensory responsiveness and multisensory modulation appears simply because extreme values move toward the mean · outcome (stated by the tagger, no quotation): held Quotation withheld because this record is not cleared for redistribution. neurons with the lowest and highest responses were removed and inverse effectiveness re-checked on what remained eliminates: that inverse effectiveness is a CEILING AND FLOOR artefact - neurons operating at the limits of their dynamic range cannot show further modulation · outcome (stated by the tagger, no quotation): held Quotation withheld because this record is not cleared for redistribution. multisensory processing multisensory processing Quotation withheld because this record is not cleared for redistribution. segregation segregation Quotation withheld because this record is not cleared for redistribution. integration integration Quotation withheld because this record is not cleared for redistribution. cue integration cue integration Quotation withheld because this record is not cleared for redistribution. MLE rule MLE rule Quotation withheld because this record is not cleared for redistribution. multisensory processing - A FAMILY OF FUNCTIONS, NOT ONE OPERATION: the review's central move is to say the term covers not only integration but also SEGREGATION of modalities, so a word the field uses for combining also names the deciding-not-to-combine, and the two have opposite outcomes Quotation withheld because this record is not cleared for redistribution. the MLE reliability claim - TRUE BY CONSTRUCTION, AND LABELLED SO: the combined estimate's reliability is the sum of the unisensory reliabilities and is therefore by definition more reliable; the empirical claim that the framework applies is separate, and only the second can fail Quotation withheld because this record is not cleared for redistribution. the definition in use - CHOSEN FOR ITS BREADTH: any process in which information across sensory modalities is combined to make a perceptual inference, attributed to Bizley et al., and stated to encompass functions that both precede and incorporate cue integration Quotation withheld because this record is not cleared for redistribution. builds-on → Bizley et al. (2016) Quotation withheld because this record is not cleared for redistribution. contradicts → van Atteveld et al. (2014) Quotation withheld because this record is not cleared for redistribution. integration —part-of→ multisensory processing integration multisensory processing strength of the relation: 1 Quotation withheld because this record is not cleared for redistribution. segregation —part-of→ multisensory processing segregation multisensory processing strength of the relation: 1 Quotation withheld because this record is not cleared for redistribution. model fitting / model comparison model fitting / model comparison Quotation withheld because this record is not cleared for redistribution. p-value p-value Quotation withheld because this record is not cleared for redistribution. The review concludes that different multisensory processes reuse the same overlapping anatomical network but are carried out by several distinct micro-circuits running in parallel, each recruited according to stimulus features and behavioral constraints. Quotation withheld because this record is not cleared for redistribution. Multisensory processing is not one operation but a family of functions that includes segregating modalities as well as integrating them. Quotation withheld because this record is not cleared for redistribution. The outcome of multisensory processing is set jointly by physical stimulus properties (bottom-up) and by cognitive resources and situational demands (top-down). Quotation withheld because this record is not cleared for redistribution. The same anatomical circuit, such as direct V1-A1 connections, can exert different effects depending on the type of stimulus, implementing distinct cross-modal behaviours. Quotation withheld because this record is not cleared for redistribution. The two population-level mechanisms previously proposed (divisive normalization and phase resetting) cannot account for the whole of multisensory processing; a larger set of computational rules is needed. Quotation withheld because this record is not cleared for redistribution. The authors argue that different circuits evolved for multi- and unisensory processing, and multisensory integration is not simply extra converging input. Quotation withheld because this record is not cleared for redistribution. Correlating unisensory responsiveness with multisensory modulation can produce a spurious inverse-effectiveness result because the two variables are not independent and are subject to regression to the mean. Quotation withheld because this record is not cleared for redistribution. The authors prescribe that any observed inverse-effectiveness correlation be tested against a null distribution built by shuffling before it is claimed as real. Quotation withheld because this record is not cleared for redistribution. Using only simple cross-modal cues biases the field toward primary sensory cortices and hides the contribution of association cortices. Quotation withheld because this record is not cleared for redistribution. Experience may switch cross-modal object recognition from a feedforward route (PPC to perirhinal cortex) to a feedback route in which perirhinal multisensory representations affect earlier sensory cortices. Quotation withheld because this record is not cleared for redistribution. Conscious experience is proposed to be a higher-order form of multisensory integration that sits above cue integration, object recognition and sensory selection, none of which alone suffices for consciousness. Quotation withheld because this record is not cleared for redistribution. Cue-integration models fit the mice's detection behaviour significantly better than a model of independent processing. Quotation withheld because this record is not cleared for redistribution. Rodents can integrate stimuli supra-linearly, better than Bayes-optimal. WHOSE RESULT THIS IS: recent studies showed - THE SUBJECT OF THIS RESULT IS AN INDEFINITE STUDY, NOT THIS PAPER. 'Previous studies reported', 'studies in guinea pig showed', 'recent studies have reported' - somebody else's work under a common noun rather than a name, with a citation in the sentence and no first-person marker. The quote is verbatim and the claim is true; only the attribution is wrong. FOUND BY MEASURING MY OWN CUE'S RECALL: the first sweep required a NAMED author as the subject ('Sperling (1960) demonstrated') and found 17. Reading eleven citation-bearing findings on 'Plakke2016' by hand showed four the cue could not see - 'A study examining recognition found', 'studies of typical human subjects have demonstrated', 'A follow up study found' - so the named cue's 17 was a floor and not a count. A CUE'S FALSE POSITIVES TELL YOU NOTHING ABOUT ITS FALSE NEGATIVES, and the only way to find these was to read a record's whole layer. Quotation withheld because this record is not cleared for redistribution. multisensory cue integration multisensory cue integration Quotation withheld because this record is not cleared for redistribution. sensory selection sensory selection Quotation withheld because this record is not cleared for redistribution. multisensory multisensory Quotation withheld because this record is not cleared for redistribution. principle of inverse effectiveness principle of inverse effectiveness Quotation withheld because this record is not cleared for redistribution. temporal principle of multisensory integration temporal principle of multisensory integration Quotation withheld because this record is not cleared for redistribution. unisensory integration unisensory integration Quotation withheld because this record is not cleared for redistribution. Maximum-Likelihood Estimate Maximum-Likelihood Estimate Quotation withheld because this record is not cleared for redistribution. divisive normalization divisive normalization Quotation withheld because this record is not cleared for redistribution. association cortices association cortices Quotation withheld because this record is not cleared for redistribution. stimulus intensity stimulus intensity Quotation withheld because this record is not cleared for redistribution. Correct responses Correct responses Quotation withheld because this record is not cleared for redistribution. 80 ms — temporal separation beyond which two cross-modal signals are likely to be treated as coming from different sources and segregated Quotation withheld because this record is not cleared for redistribution. 0–100 ms — the lead time by which a somatosensory stimulus must precede a visual one for layer-4 responses in rat parietal cortex to be enhanced rather than suppressed Quotation withheld because this record is not cleared for redistribution. 100% — the misleadingly large percentage increase produced by one extra spike when the baseline response is a single spike, used to argue against percentage metrics of multisensory modulation Quotation withheld because this record is not cleared for redistribution. p < 0.01 — significance of the drop in novel-object exploration ratio after perirhinal-parietal disconnection lesions in cross-modal object recognition Quotation withheld because this record is not cleared for redistribution.

The full text of this article is not redistributable, so it is not included here. The evidence sentences are withheld with it; the tag layer and its grounding status remain. The article itself is at https://doi.org/10.1016/j.pneurobio.2019.01.004.