<?xml version="1.0" encoding="UTF-8"?>
<TEI xmlns="http://www.tei-c.org/ns/1.0" xml:lang="en">
  <teiHeader>
    <fileDesc>
      <titleStmt>
        <title>Have We Forgotten Auditory Sensory Memory? Retention Intervals in Studies of Nonverbal Auditory Working Memory</title>
        <author>Nees</author>
      </titleStmt>
      <publicationStmt>
        <p>Tag layer of the DHSS Meta-Tagging Project. The article text is reproduced from the
           staged copy named in sourceDesc and is not altered; the tags are held separately in
           standOff so that overlapping and nested spans are preserved.</p>
      </publicationStmt>
      <sourceDesc>
        <bibl>
          <title>Have We Forgotten Auditory Sensory Memory? Retention Intervals in Studies of Nonverbal Auditory Working Memory</title>
          <date>2016</date>
          <publisher>Frontiers in Psychology</publisher>
          <idno type="DOI">10.3389/fpsyg.2016.01892</idno>
          
          <idno type="record">Nees2016-have-we-forgotten-auditory-sensory-memory-re</idno>
          <note type="staged-file">Nees2016-have-we-forgotten-auditory-sensory-memory-re.txt, the project's staged copy</note>
          <note type="text-sha1">858ce9edea1cc53680cd8da45578b28b4a26ec53</note>
          <note type="rights">not-redistributable</note>
        </bibl>
      </sourceDesc>
    </fileDesc>
    <profileDesc>
      <textClass><keywords><term>cognitive-psychology</term></keywords></textClass>
      <particDesc>
        <person xml:id="paper"><p>the paper's own words</p></person>
        <person xml:id="tagger"><p>the tag layer; a sentence written by the tagger about the
          paper, always anchored to a quotation but not itself a quotation</p></person>
      </particDesc>
    </profileDesc>
    <revisionDesc>
      <change when="2026-10-06"
              who="build_paper_edition.py">74 spans located by searching the stored text for the quote's exact words, allowing any whitespace between them</change>
    </revisionDesc>
  </teiHeader>
  <standOff>
    <spanGrp type="tags">
      <span xml:id="t0" from="#a4" to="#a5" type="object_of_study" ana="#object_of_study" resp="#paper">The retention intervals used in nonverbal auditory working-memory experiments, and whether they are long enough to exclude auditory sensory memory.</span>
      <span xml:id="t1" from="#a43" to="#a44" type="research_question" ana="#research_question" resp="#paper">When a study reports working memory for a nonverbal sound after a few seconds, is it measuring working memory at all, or the sensory trace that persists alongside it?</span>
      <span xml:id="t2" from="#a12" to="#a13" type="contribution" ana="#contribution" resp="#paper">Shows that the conventional 3-5 s retention interval does not exclude auditory sensory memory, so a body of findings attributed to working memory is ambiguous between two constructs.</span>
      <span xml:id="t3" from="#a10" to="#a11" type="claim_type" ana="#claim_type" resp="#paper">critique</span>
      <span xml:id="t4" from="#a1" to="#a2" type="phenomenon" ana="#phenomenon" resp="#paper">nonverbal auditory working memory</span>
      <span xml:id="t5" from="#a8" to="#a9" type="method" ana="#method" resp="#paper">review<term>review</term></span>
      <span xml:id="t6" from="#a45" to="#a46" type="mechanisms" ana="#mechanisms[0]" resp="#tagger">mechanisms<term>during a short retention interval the lingering sensory trace and the rehearsed working-memory trace remain available in parallel, so the participant can answer from either, and the experimenter cannot attribute performance to one store</term></span>
      <span xml:id="t7" from="#a65" to="#a66" type="mechanisms" ana="#mechanisms[1]" resp="#tagger">mechanisms<term>sensory memory keeps task performance intact when rehearsal is blocked, so a genuinely interfering secondary task can still yield a null result that is then misread as showing the two tasks use different mechanisms</term></span>
      <span xml:id="t8" from="#a43" to="#a44" type="mechanisms" ana="#mechanisms[2]" resp="#tagger" cert="1.0">mechanisms<term>the two memories run in parallel, so while the sensory trace survives, either one can drive the response and the experiment cannot tell which did</term></span>
      <span xml:id="t9" from="#a41" to="#a42" type="mechanisms" ana="#mechanisms[3]" resp="#tagger" cert="1.0">mechanisms<term>the convention arose from an early estimate that the sensory trace lasted about two seconds, which later work did not support</term></span>
      <span xml:id="t10" from="#a35" to="#a36" type="mechanisms" ana="#mechanisms[4]" resp="#tagger" cert="0.9">mechanisms<term>the verbal literature escaped the problem because serial recall lets primacy and recency separate rehearsal from the sensory trace; nonverbal sounds cannot be recalled aloud, so that separation is unavailable</term></span>
      <span xml:id="t11" from="#a69" to="#a70" type="limitations" ana="#limitations[0]" resp="#tagger">The paper cannot prescribe a retention-interval duration that would definitively remove auditory sensory memory, because estimates of that memory&#x27;s duration vary too widely.<note>what this limits: any recommendation of a retention interval: THE INDETERMINATE DURATION OF ASM PRECLUDES RECOMMENDING A DEFINITIVE RETENTION INTERVAL DURATION THAT WOULD ELIMINATE CONTRIBUTIONS OF ASM</note></span>
      <span xml:id="t12" from="#a81" to="#a82" type="limitations" ana="#limitations[1]" resp="#tagger">The alternative remedy the paper discusses - overwriting the sensory trace with an irrelevant sound - lacks the empirical evidence needed to justify assuming it works.<note>what this limits: the overwriting remedy: WITHOUT DEFINITIVE EMPIRICAL EVIDENCE, IT SEEMS UNWARRANTED TO ASSUME THAT A NOISE BURST OR A COMPOSITE STIMULUS WILL ELIMINATE CONTRIBUTIONS OF ASM TO WM TASKS</note></span>
      <span xml:id="t13" from="#a7" to="#a9" type="limitations" ana="#limitations[2]" resp="#tagger" cert="0.9">The paper is a commentary: it identifies an interpretive ambiguity and does not measure how much of any published effect is actually sensory.</span>
      <span xml:id="t14" from="#a49" to="#a50" type="limitations" ana="#limitations[3]" resp="#tagger" cert="1.0">The critique rests on duration estimates that themselves vary by a factor of thirty, so it cannot say which interval would be long enough.<note>what this limits: every duration-based argument in the comment: RESEARCH HAS SHOWN STRIKING VARIATION IN THE ESTIMATED DURATION OF ASM</note></span>
      <span xml:id="t15" from="#a18" to="#a19" type="concepts" ana="#concepts[0]" resp="#paper" cert="1.0">auditory sensory memory<term>auditory sensory memory</term></span>
      <span xml:id="t16" from="#a16" to="#a17" type="concepts" ana="#concepts[1]" resp="#paper" cert="1.0">echoic memory<term>echoic memory</term></span>
      <span xml:id="t17" from="#a24" to="#a25" type="concepts" ana="#concepts[2]" resp="#paper" cert="1.0">working memory<term>working memory</term></span>
      <span xml:id="t18" from="#a20" to="#a22" type="concepts" ana="#concepts[3]" resp="#paper" cert="1.0">short-term store<term>short-term store</term></span>
      <span xml:id="t19" from="#a14" to="#a15" type="concepts" ana="#concepts[4]" resp="#paper" cert="1.0">sensory register<term>sensory register</term></span>
      <span xml:id="t20" from="#a4" to="#a5" type="concepts" ana="#concepts[5]" resp="#paper" cert="1.0">retention interval<term>retention interval</term></span>
      <span xml:id="t21" from="#a3" to="#a5" type="concepts" ana="#concepts[6]" resp="#paper" cert="0.85">two-stimulus comparison tasks<term>two-stimulus comparison tasks</term></span>
      <span xml:id="t22" from="#a30" to="#a34" type="concepts" ana="#concepts[7]" resp="#paper" cert="0.9">serial recall<term>serial recall</term></span>
      <span xml:id="t23" from="#a53" to="#a54" type="concepts" ana="#concepts[8]" resp="#paper" cert="1.0">mismatch negativity<term>mismatch negativity</term></span>
      <span xml:id="t24" from="#a26" to="#a27" type="concepts" ana="#concepts[9]" resp="#paper" cert="1.0">rehearsal<term>rehearsal</term></span>
      <span xml:id="t25" from="#a28" to="#a29" type="concepts" ana="#concepts[10]" resp="#paper" cert="1.0">auditory imagery<term>auditory imagery</term></span>
      <span xml:id="t26" from="#a18" to="#a19" type="senses" ana="#senses[0]" resp="#tagger" cert="1.0">memory - the passive sensory kind: a high-resolution trace of what was just heard, not manipulable and not under attentional control</span>
      <span xml:id="t27" from="#a24" to="#a25" type="senses" ana="#senses[1]" resp="#tagger" cert="1.0">memory - the working kind: active manipulation, rehearsal and reinstatement, able to run without any sound having been heard</span>
      <span xml:id="t28" from="#a20" to="#a22" type="senses" ana="#senses[2]" resp="#tagger" cert="0.9">short-term memory - used loosely as a synonym for working memory, which the paper identifies as part of how the two constructs got conflated</span>
      <span xml:id="t29" from="#a61" to="#a62" type="alternatives" ana="#alternatives.claim_type" resp="#tagger">claim_type: critique<note>a second reading reaching the same value. Recorded: critique — note: a second reading reaching the same value from a different sentence. Not applied - a person decides.</note></span>
      <span xml:id="t30" from="#a7" to="#a9" type="alternatives" ana="#alternatives.method" resp="#tagger">method: conceptual-analysis<note>a second reading DIFFERING from the recorded value. Recorded: review — note: a second reading, verbatim-verified, disagreeing with the value on the record. Not applied - a person decides.</note></span>
      <span xml:id="t31" from="#a47" to="#a48" type="alternatives" ana="#alternatives.phenomenon" resp="#tagger">phenomenon: conflation of auditory sensory memory with working memory in two-stimulus comparison tasks<note>a second reading DIFFERING from the recorded value. Recorded: nonverbal auditory working memory — note: a second reading, verbatim-verified, disagreeing with the value on the record. Not applied - a person decides.</note></span>
      <span xml:id="t32" from="#a57" to="#a58" type="claim_relations" ana="#claim_relations[0]" resp="#tagger">contradicts → Golubock and Janata (2013)</span>
      <span xml:id="t33" from="#a59" to="#a60" type="claim_relations" ana="#claim_relations[1]" resp="#tagger">contradicts → Soemer and Saito (2015)</span>
      <span xml:id="t34" from="#a57" to="#a58" type="claim_relations" ana="#claim_relations[2]" resp="#tagger" cert="1.0">contradicts → studies treating any post-stimulus retention as working memory, e.g. Golubock and Janata (2013)</span>
      <span xml:id="t35" from="#a55" to="#a56" type="claim_relations" ana="#claim_relations[3]" resp="#tagger" cert="1.0">builds-on → Schröger&#x27;s (2007) review of mismatch negativity studies</span>
      <span xml:id="t36" from="#a14" to="#a15" type="claim_relations" ana="#claim_relations[4]" resp="#tagger" cert="1.0">builds-on → Atkinson and Shiffrin&#x27;s (1968) three-store memory model</span>
      <span xml:id="t37" from="#a16" to="#a17" type="concept_edges" ana="#concept_edges[0]" resp="#tagger">echoic memory —same-as→ auditory sensory memory<note>strength of the relation: 1</note><term>echoic memory</term><term>auditory sensory memory</term></span>
      <span xml:id="t38" from="#a20" to="#a22" type="concept_edges" ana="#concept_edges[1]" resp="#tagger">short-term store —renamed-across-fields→ working memory<note>strength of the relation: 0.7 · note: the quote says the short-term store EVOLVED INTO the working memory construct - a succession over time, not an identity. retyped 2026-08-12 after the same-as transitivity audit. renamed-across-fields is the closest of the eight types but it is wrong in the detail: this is diachronic within one field, not across fields. Cowan2008 in this same corpus spends its length distinguishing the two.
Audit 2026-09-28: DOUBTFUL - read against its span and kept, but the short-term store EVOLVED INTO working memory within one field; renamed-across-fields overstates it.</note><term>short-term store</term><term>working memory</term></span>
      <span xml:id="t39" from="#a61" to="#a62" type="concept_edges" ana="#concept_edges[2]" resp="#tagger">auditory sensory memory —distinct-from→ working memory<note>strength of the relation: 1</note><term>auditory sensory memory</term><term>working memory</term></span>
      <span xml:id="t40" from="#a53" to="#a54" type="concept_edges" ana="#concept_edges[3]" resp="#tagger">auditory sensory memory —operationalised-as→ mismatch negativity<note>strength of the relation: 1</note><term>auditory sensory memory</term><term>mismatch negativity</term></span>
      <span xml:id="t41" from="#a24" to="#a25" type="concept_edges" ana="#concept_edges[4]" resp="#tagger">rehearsal —part-of→ working memory<note>strength of the relation: 1</note><term>rehearsal</term><term>working memory</term></span>
      <span xml:id="t42" from="#a10" to="#a11" type="concept_edges" ana="#concept_edges[5]" resp="#tagger">two-stimulus comparison tasks —contrasted-with→ serial recall<note>strength of the relation: 0.9</note><term>two-stimulus comparison tasks</term><term>serial recall</term></span>
      <span xml:id="t43" from="#a83" to="#a84" type="content_tags" ana="#content_tags.findings[0]" resp="#tagger">The retention intervals conventionally used in nonverbal auditory two-stimulus comparison tasks may have let sensory memory affect results attributed to working-memory rehearsal.</span>
      <span xml:id="t44" from="#a51" to="#a52" type="content_tags" ana="#content_tags.findings[1]" resp="#tagger">Published estimates of the duration of the auditory sensory trace disagree enormously, running from 2 s or less through 3.5 s, 4-5 s, 10 s, 10-15 s, 20 s and 30 s up to possibly 60 s.</span>
      <span xml:id="t45" from="#a73" to="#a74" type="content_tags" ana="#content_tags.findings[2]" resp="#tagger">Retention intervals under 5 s fall within many published estimates of sensory-memory persistence, while intervals of 8-10 s or more begin to exceed many, but not all, of them.</span>
      <span xml:id="t46" from="#a71" to="#a72" type="content_tags" ana="#content_tags.findings[3]" resp="#tagger">The duration of auditory sensory memory appears subject to considerable individual differences.</span>
      <span xml:id="t47" from="#a79" to="#a80" type="content_tags" ana="#content_tags.findings[4]" resp="#tagger">White noise produced no suffix effect for digits or tones, which casts doubt on white noise as a stimulus that overwrites sensory memory.<note>WHOSE RESULT THIS IS: Greene and Samuel (1986) showed - THE EVIDENCE FOR THIS ROW ATTRIBUTES THE WORK TO SOMEBODY ELSE. The cited name is the subject of a result verb and the sentence carries no first-person marker, so the finding, quantity or definition is the CITED author&#x27;s rather than this record&#x27;s. The claim is true and the quote is verbatim - what is wrong is whose result the corpus says it is. Nothing edited, nothing withdrawn: the row is marked so a page can name the source. Where the record is a commentary or review, its claim relations layer usually already names the paper being discussed - the record knows at one layer and forgets at another.</note></span>
      <span xml:id="t48" from="#a63" to="#a64" type="content_tags" ana="#content_tags.findings[5]" resp="#tagger">With a 6 s retention interval, articulatory suppression impaired memory for nonverbal sounds relative to a control condition.<note>WHOSE RESULT THIS IS: Siedenburg and McAdams (2016) reported - THE EVIDENCE FOR THIS ROW ATTRIBUTES THE WORK TO SOMEBODY ELSE. A cited name is the subject of a result verb and the sentence carries no first-person marker, so the finding, quantity or definition is the CITED author&#x27;s rather than this record&#x27;s. The claim is true and the quote is verbatim - what is wrong is whose result the corpus says it is. Nothing edited, nothing withdrawn: the row is marked so a page can name the source. Written by the same predicate and in the same shape as the 18 rows that already carried attributed to, found by sweeping for the pattern those 18 demonstrate. SEVERAL OF THESE RECORDS ARE REVIEWS - &#x27;Camina2017&#x27; 6, &#x27;Nees2016&#x27; 4 - where other people&#x27;s results are the point of the paper, and the mark is what keeps the corpus from claiming them.</note></span>
      <span xml:id="t49" from="#a31" to="#a32" type="content_tags" ana="#content_tags.findings[6]" resp="#tagger">Verbal serial recall separates the two stores by serial position - primacy indexes rehearsal in working memory and auditory recency indexes sensory memory.</span>
      <span xml:id="t50" from="#a67" to="#a68" type="content_tags" ana="#content_tags.findings[7]" resp="#tagger">Four mechanisms have been proposed for working memory of nonverbal sounds: the verbal phonological loop, a separate music memory loop, attention, and different mechanisms for pitch versus timbre.</span>
      <span xml:id="t51" from="#a12" to="#a13" type="content_tags" ana="#content_tags.findings[8]" resp="#tagger">The comment proposes that conflating sensory memory with working memory may be one contributor to the field&#x27;s discrepant findings and its proliferation of theories.</span>
      <span xml:id="t52" from="#a51" to="#a52" type="content_tags" ana="#content_tags.findings[9]" resp="#tagger" cert="1.0">Estimates of how long auditory sensory memory lasts range from 2 seconds or less to possibly 60.</span>
      <span xml:id="t53" from="#a55" to="#a56" type="content_tags" ana="#content_tags.findings[10]" resp="#tagger" cert="1.0">A review of MMN studies concluded that the auditory sensory trace may endure up to 20 seconds or longer.<note>WHOSE RESULT THIS IS: Schröger (2007) concluded - THE EVIDENCE FOR THIS ROW ATTRIBUTES THE WORK TO SOMEBODY ELSE. A cited name is the subject of a result verb and the sentence carries no first-person marker, so the finding, quantity or definition is the CITED author&#x27;s rather than this record&#x27;s. The claim is true and the quote is verbatim - what is wrong is whose result the corpus says it is. Nothing edited, nothing withdrawn: the row is marked so a page can name the source. Written by the same predicate and in the same shape as the 18 rows that already carried attributed to, found by sweeping for the pattern those 18 demonstrate. SEVERAL OF THESE RECORDS ARE REVIEWS - &#x27;Camina2017&#x27; 6, &#x27;Nees2016&#x27; 4 - where other people&#x27;s results are the point of the paper, and the mark is what keeps the corpus from claiming them.</note></span>
      <span xml:id="t54" from="#a57" to="#a58" type="content_tags" ana="#content_tags.findings[11]" resp="#tagger" cert="1.0">Published studies have called retention of a sound &#x27;working memory&#x27; after intervals as short as one second.</span>
      <span xml:id="t55" from="#a33" to="#a34" type="content_tags" ana="#content_tags.findings[12]" resp="#tagger" cert="1.0">The verbal working-memory literature did separate the two contributions; the nonverbal literature did not.</span>
      <span xml:id="t56" from="#a21" to="#a23" type="content_tags" ana="#content_tags.definitions[3]" resp="#tagger">working memory (WM)<term>working memory (WM)</term></span>
      <span xml:id="t57" from="#a3" to="#a6" type="content_tags" ana="#content_tags.definitions[4]" resp="#tagger">two-stimulus comparison task<term>two-stimulus comparison task</term></span>
      <span xml:id="t58" from="#a37" to="#a38" type="content_tags" ana="#content_tags.definitions[5]" resp="#tagger">retention interval<term>retention interval</term></span>
      <span xml:id="t59" from="#a77" to="#a78" type="content_tags" ana="#content_tags.definitions[6]" resp="#tagger">suffix effect<term>suffix effect</term></span>
      <span xml:id="t60" from="#a16" to="#a17" type="content_tags" ana="#content_tags.definitions[7]" resp="#tagger" cert="1.0">echoic memory<term>echoic memory</term></span>
      <span xml:id="t61" from="#a18" to="#a19" type="content_tags" ana="#content_tags.definitions[8]" resp="#tagger" cert="1.0">auditory sensory memory<term>auditory sensory memory</term></span>
      <span xml:id="t62" from="#a3" to="#a6" type="content_tags" ana="#content_tags.quantities[0]" resp="#tagger">3–5 s — the brief retention interval typically separating the two sounds in these comparison tasks</span>
      <span xml:id="t63" from="#a41" to="#a42" type="content_tags" ana="#content_tags.quantities[1]" resp="#tagger">2 s — the maximum sensory-trace duration originally assumed, which licensed treating any longer interval as sensory-memory-free</span>
      <span xml:id="t64" from="#a55" to="#a56" type="content_tags" ana="#content_tags.quantities[2]" resp="#tagger">20 s — the sensory-memory duration a review of mismatch-negativity studies concluded was possible<note>WHOSE RESULT THIS IS: Schröger (2007) concluded - THE EVIDENCE FOR THIS ROW ATTRIBUTES THE WORK TO SOMEBODY ELSE. A cited name is the subject of a result verb and the sentence carries no first-person marker, so the finding, quantity or definition is the CITED author&#x27;s rather than this record&#x27;s. The claim is true and the quote is verbatim - what is wrong is whose result the corpus says it is. Nothing edited, nothing withdrawn: the row is marked so a page can name the source. Written by the same predicate and in the same shape as the 18 rows that already carried attributed to, found by sweeping for the pattern those 18 demonstrate. SEVERAL OF THESE RECORDS ARE REVIEWS - &#x27;Camina2017&#x27; 6, &#x27;Nees2016&#x27; 4 - where other people&#x27;s results are the point of the paper, and the mark is what keeps the corpus from claiming them.</note></span>
      <span xml:id="t65" from="#a39" to="#a40" type="content_tags" ana="#content_tags.quantities[3]" resp="#tagger">5 s — the retention interval used in the seminal tonal-memory studies that set the convention</span>
      <span xml:id="t66" from="#a57" to="#a58" type="content_tags" ana="#content_tags.quantities[4]" resp="#tagger">1 s — the shortest post-stimulus retention that a recent study still labelled a working-memory task</span>
      <span xml:id="t67" from="#a75" to="#a76" type="content_tags" ana="#content_tags.quantities[5]" resp="#tagger">200 ms — duration of the white-noise burst used as a post-stimulus mask intended to overwrite the sensory trace</span>
      <span xml:id="t68" from="#a73" to="#a74" type="content_tags" ana="#content_tags.quantities[6]" resp="#tagger">8–10 s — the interval length at which retention begins to exceed most estimates of sensory-memory persistence</span>
      <span xml:id="t69" from="#a4" to="#a5" type="content_tags" ana="#content_tags.quantities[7]" resp="#tagger" cert="1.0">3–5 s — the conventional retention interval in two-stimulus comparison tasks - the number the critique is about</span>
      <span xml:id="t70" from="#a51" to="#a52" type="content_tags" ana="#content_tags.quantities[8]" resp="#tagger" cert="1.0">2 s to 60 s — the full range of published estimates for the duration of auditory sensory memory</span>
      <span xml:id="t71" from="#a55" to="#a56" type="content_tags" ana="#content_tags.quantities[9]" resp="#tagger" cert="1.0">20 s or longer — duration of the sensory trace as estimated from mismatch negativity studies<note>WHOSE RESULT THIS IS: Schröger (2007) concluded - THE EVIDENCE FOR THIS ROW ATTRIBUTES THE WORK TO SOMEBODY ELSE. A cited name is the subject of a result verb and the sentence carries no first-person marker, so the finding, quantity or definition is the CITED author&#x27;s rather than this record&#x27;s. The claim is true and the quote is verbatim - what is wrong is whose result the corpus says it is. Nothing edited, nothing withdrawn: the row is marked so a page can name the source. Written by the same predicate and in the same shape as the 18 rows that already carried attributed to, found by sweeping for the pattern those 18 demonstrate. SEVERAL OF THESE RECORDS ARE REVIEWS - &#x27;Camina2017&#x27; 6, &#x27;Nees2016&#x27; 4 - where other people&#x27;s results are the point of the paper, and the mark is what keeps the corpus from claiming them.</note></span>
      <span xml:id="t72" from="#a57" to="#a58" type="content_tags" ana="#content_tags.quantities[10]" resp="#tagger" cert="1.0">1 s — the shortest interval a published study has called working memory</span>
      <span xml:id="t73" from="#a4" to="#a5" type="content_tags" ana="#content_tags.variables[0]" resp="#tagger" cert="1.0">retention interval<term>retention interval</term></span>
    </spanGrp>
  </standOff>
  <text>
    <body>
        <p><anchor xml:id="a0"/>Have We Forgotten Auditory Sensory Memory? Retention Intervals in Studies of Nonverbal Auditory Working Memory</p>
        <p>Michael A Nees   Michael A Nees</p>
        <p>1 Department of Psychology, Lafayette College, Easton, PA, USA</p>
        <p>Find articles by Michael A Nees</p>
        <p>1, *</p>
        <p>Author information</p>
        <p>Article notes</p>
        <p>Copyright and License information</p>
        <p>1 Department of Psychology, Lafayette College, Easton, PA, USA</p>
        <p>Edited by: Claude Alain, Rotman Research Institute, Canada</p>
        <p>Reviewed by: Jochen Kaiser, Goethe University Frankfurt, Germany; Jonas Obleser, University of Lübeck, Germany</p>
        <p>✉ *Correspondence: Michael A. Nees, neesm@lafayette.edu ; nees.michael@gmail.com</p>
        <p>This article was submitted to Auditory Cognitive Neuroscience, a section of the journal Frontiers in Psychology</p>
        <p>Received 2016 Sep 23; Accepted 2016 Nov 17; Collection date 2016.</p>
        <p>Copyright © 2016 Nees.</p>
        <p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
        <p>PMC Copyright notice</p>
        <p>PMCID: PMC5133429  PMID: 27994565</p>
        <p>Abstract</p>
        <p><anchor xml:id="a1"/>Researchers have shown increased interest in mechanisms of working memory for nonverbal sounds such as music and environmental sounds.<anchor xml:id="a2"/> <anchor xml:id="a3"/>These studies often have used two-stimulus comparison tasks: <anchor xml:id="a4"/>two sounds separated by a brief retention interval (often 3–5 s) are compared, and a “same” or “different” judgment is recorded<anchor xml:id="a5"/>.<anchor xml:id="a6"/> <anchor xml:id="a7"/>Researchers seem to have assumed that sensory memory has a negligible impact on performance in auditory two-stimulus comparison tasks. <anchor xml:id="a8"/>This assumption is examined in detail in this comment.<anchor xml:id="a9"/> According to seminal texts and recent research reports, sensory memory persists in parallel with working memory for a period of time following hearing a stimulus and can influence behavioral responses on memory tasks. <anchor xml:id="a10"/>Unlike verbal working memory studies that use serial recall tasks, research paradigms for exploring nonverbal working memory—especially two-stimulus comparison tasks—may not be differentiating working memory from sensory memory processes in analyses of behavioral responses, because retention interval durations have not excluded the possibility that the sensory memory trace drives task performance.<anchor xml:id="a11"/> <anchor xml:id="a12"/>This conflation of different constructs may be one contributor to discrepant research findings and the resulting proliferation of theoretical conjectures regarding mechanisms of working memory for nonverbal sounds.<anchor xml:id="a13"/></p>
        <p>Keywords: auditory sensory memory, working memory, auditory cognition, nonverbal sounds, music cognition</p>
        <p><anchor xml:id="a14"/>Atkinson and Shiffrin’s (1968) influential memory model described a sensory register , a short-term store , and a long-term store .<anchor xml:id="a15"/> <anchor xml:id="a16"/>Neisser (1967) dubbed the auditory sensory store echoic memory —a term synonymous with auditory sensory memory (ASM).<anchor xml:id="a17"/> Contemporary research has established that ASM is: (1) auditory modality-specific; (2) high in resolution, which seems to indicate storage of episodic rather than categorical or abstract information; (3) limited in duration; and (4) independent from attentional processes ( Näätänen et al., 1989 ; Winkler and Cowan, 2005 ). <anchor xml:id="a18"/>Thus, ASM is a passive store of just-heard sounds that retains a “synthesized auditory memory” ( Massaro, 1975 )<anchor xml:id="a19"/>—a set of acoustic features organized in time that can be consulted to complete behavioral tasks, including comparing sounds to one another (e.g., Crowder, 1982 ).</p>
        <p><anchor xml:id="a20"/>Auditory sensory memory is qualitatively different from post-sensory memory <anchor xml:id="a21"/>processes ( Massaro, 1972 ; Crowder, 1982 ), including Atkinson and Shiffrin’s short-term store, which evolved into the working memory (WM) construct (see, e.g., Logie and Cowan, 2015 ).<anchor xml:id="a22"/> WM receives input from sensory memory about recent perceptual experiences, maintains and manipulates information during in-progress cognitive activities, and interfaces with long-term memory to reinstate information from the latent, permanent corpus of previous experiences.<anchor xml:id="a23"/> <anchor xml:id="a24"/>These “working” aspects of WM— active mental manipulation, rehearsal, and reinstatement of information— represent an important functional distinction between WM and ASM.<anchor xml:id="a25"/> <anchor xml:id="a26"/>ASM does not involve active manipulation or rehearsal (see, especially, Green and McKeown, 2007 , Experiment 2; also see McKeown and Mercer, 2012 ) and is insensitive to attentional processes<anchor xml:id="a27"/> ( Näätänen et al., 1989 ; Winkler and Cowan, 2005 ), including WM rehearsal processes ( Nees and Best, 2013 ; Nees and Walker, 2013 ). <anchor xml:id="a28"/>Further, ASM is only engaged when a sound is heard, whereas WM for sounds can be initiated in the absence of hearing a stimulus (i.e., when a sound is reinstated from long-term memory, as in auditory imagery).<anchor xml:id="a29"/></p>
        <p>ASM in Verbal Versus Nonverbal Auditory WM Tasks</p>
        <p>Contributions of ASM to task performance have been acknowledged in studies of WM for speech and language (i.e., verbal WM). <anchor xml:id="a30"/>Auditory verbal WM often has been studied using serial recall tasks. Participants hear a list of words, letters, or digits, then immediately write or speak aloud all of the items. <anchor xml:id="a31"/>Analysis of memory for each list position permits dissociations of performance driven by WM rehearsal processes (e.g., primacy effects—recall advantages in the early portion of lists due to extended rehearsal time) from performance driven by ASM (e.g., auditory recency—better recall for the last few items with auditory presentation).<anchor xml:id="a32"/> <anchor xml:id="a33"/>Thus, in the verbal WM literature, the respective contributions of WM rehearsal and ASM have been disentangled in empirical investigations and their accompanying theoretical interpretations (see Jones et al., 2004 , 2006 ).<anchor xml:id="a34"/></p>
        <p><anchor xml:id="a35"/>Nonverbal sounds typically are not amenable to recall tasks, because participants would need to respond verbally<anchor xml:id="a36"/> (e.g., by labeling the sound, see Paivio et al., 1975 ; also see Kumar et al., 2013 for an exception). Thus, participants might rehearse the sounds in WM as their verbal labels rather than remembering the sounds per se . Instead of recall tasks, studies of nonverbal auditory WM often have used two-stimulus comparison tasks (for a review, see Cowan, 1984 ). Participants hear an initial sound and compare it to a second sound following a retention interval. <anchor xml:id="a37"/>The duration of the retention interval—the time during which the initial sound must be remembered—typically has been a few seconds.<anchor xml:id="a38"/> <anchor xml:id="a39"/>For example, Deutsch’s seminal studies of tonal memory (reviewed in Deutsch, 1975 ) used 5 s retention intervals.<anchor xml:id="a40"/> Intervals of a few seconds became conventional for several reasons. Memory performance declines over time ( Cowan et al., 1999 ), so the interval must be short enough to leave some memory intact over the short-term. To capture post-sensory processes, however, retention intervals must be long enough to exceed the duration of ASM. <anchor xml:id="a41"/>Researchers initially speculated that the maximum duration of the ASM trace was about 2 s or less (e.g., Neisser, 1967 ; Crowder, 1976 ), which suggested that negligible contributions of ASM to memory performance could be assumed when intervals exceeded 2 s.<anchor xml:id="a42"/> Further, practical considerations when implementing experimental procedures (e.g., participant fatigue or methods requiring a large number of trials) make shorter retention intervals attractive.</p>
        <p>ASM and WM Occur in Parallel</p>
        <p><anchor xml:id="a43"/>The retention interval must extend beyond the persistence of ASM to isolate WM processes, because information about the most recently heard stimulus is simultaneously available to both ASM and WM (e.g., rehearsal) processes.<anchor xml:id="a44"/> Deutsch (1975 , p. 110) noted “…we can store nonverbal stimulus attributes over substantially longer time periods…It must be concluded that the sensory attributes of a stimulus survive in memory after verbal encoding, and that they continue to be retained in parallel with the verbal attributes.” Similar views on parallel access to ASM and WM were expressed in seminal memory texts ( Massaro, 1975 ; Crowder, 1976 ; Underwood, 1976 ).</p>
        <p>Empirical findings have supported parallel representation in ASM and WM. Nees and Walker (2013) asked participants to encode two-note sound sounds with increasing or decreasing intervals, visual words (“increasing” or “decreasing”), or images (simple increasing or decreasing graphs). All stimulus forms indicated equivalent information: either an increasing or decreasing state. WM encoding strategies also were manipulated; participants were instructed to encode and rehearse the initial stimulus as either a sound (i.e., auditory imagery), a word (verbal encoding), or an image (visual imagery). Following a 3 s retention interval, participants made a speeded same/different response to a second stimulus, which could be either a sound, a word, or an image. Response times to the second stimulus were examined across factorial combinations of initial stimulus format, encoding strategy, and response stimulus format. Results generally showed that participants responded faster when the format of the second stimulus matched the strategy with which they rehearsed the initial stimulus in WM, but results also showed an independent effect of the initial stimulus format. When the initial stimulus was a sound, participants were faster to respond when the second stimulus was also a sound, regardless of (i.e., collapsed across) the WM encoding strategy. No such compatibility between the stimulus formats was observed for the visually presented words or images. These findings demonstrated that the effects of ASM persisted in parallel with recoding in WM (also see Nees and Best, 2013 ).</p>
        <p>Simultaneous representation in ASM and WM presents difficulties for isolating the construct of interest during performance of two-stimulus comparison tasks. Figure 1 depicts two retention intervals following the offset of an auditory stimulus in a two-stimulus comparison task. <anchor xml:id="a45"/>With Retention Interval A, the participant could consult either the lingering ASM trace 1 or the rehearsed WM trace to decide whether the standard and comparison stimuli are the same or different; both memory traces exist in parallel.<anchor xml:id="a46"/> With retention Interval B, ASM is no longer available when the comparison stimulus arrives; performance of the task must be accomplished using the rehearsed WM representation of the standard stimulus. <anchor xml:id="a47"/>Interpretation of observed memory performance for Retention Interval A is ambiguous—participants’ memory performance could reflect the fidelity of the ASM trace, the fidelity of the representation rehearsed in WM, or some combination of information from both sources.<anchor xml:id="a48"/></p>
        <p>FIGURE 1.</p>
        <p>Open in a new tab</p>
        <p>Hypothetical availability of the ASM trace for two different retention intervals .</p>
        <p>As such, the attribution of task performance to WM mechanisms in two-stimulus comparison tasks hinges on the assumption that the ASM trace does not survive the duration of the retention interval. This assumption may be questionable for brief retention intervals. <anchor xml:id="a49"/>Research has shown striking variation in the estimated duration of ASM.<anchor xml:id="a50"/> <anchor xml:id="a51"/>Though some researchers have estimated it to be 2 s or less ( Crowder, 1976 ; Huron and Parncutt, 1993 ), longer estimates have included 3.5 s ( Mcevoy et al., 1997 ), 4–5 s ( Glucksberg and Cowen, 1970 ), at least several seconds ( Cowan, 1984 ), 10 s ( Sams et al., 1993 ), 10–15 s ( Winkler and Cowan, 2005 ), 20 s ( Watkins and Todres, 1980 ), at least 30 s ( Winkler et al., 2002 ), and possibly up to 60 s ( Engle and Roberts, 1982 ).<anchor xml:id="a52"/></p>
        <p>ASM and WM in Cognitive Neuroscience</p>
        <p>Cognitive neuroscience research has corroborated parallel ASM and WM processes (e.g., Buchsbaum et al., 2005 ), and separate neurological markers have been identified for ASM and auditory WM processes. <anchor xml:id="a53"/>The widely researched mismatch negativity (MMN) component (see Näätänen, 2000 ) of evoked neural responses to sounds offers a metric of the duration of ASM.<anchor xml:id="a54"/> <anchor xml:id="a55"/>In a review of MMN studies, Schröger (2007) concluded that ASM may endure up to 20 s or longer.<anchor xml:id="a56"/> Regarding auditory WM, recent research ( Lim et al., 2015 ) showed that processes involving maintenance of sounds are indexed by oscillations that fall within the alpha range of frequencies in electroencephalography (EEG) recordings. Wilsch and Obleser (2016) suggested that the power fluctuations of alpha oscillations track top-down attentional processes that serve to maintain representations in WM, perhaps while simultaneously inhibiting incoming sensory input that could potentially interfere with maintenance (also see Zimmermann et al., 2016 ).</p>
        <p>Forgetting Sensory Memory?</p>
        <p>Despite evidence that ASM is distinct from WM and may persist for longer than a couple of seconds, results from two-stimulus comparison tasks in studies of nonverbal auditory WM have been interpreted with indifference toward ASM. In recent research reports on nonverbal auditory stimuli, the term “WM” has been used to describe memory over any period of time whatsoever following hearing a sound. <anchor xml:id="a57"/>Golubock and Janata (2013) defined retention of a sound for as brief as 1 s following stimulation as a WM task.<anchor xml:id="a58"/> <anchor xml:id="a59"/>Using retention intervals as brief as 3 s, Soemer and Saito (2015) likewise implied that the retention of a sound for any duration following stimulation must be accomplished by an active WM maintenance mechanism (also see Schulze et al., 2012 ). Schendel and Palmer (2007) used a 4.2 s retention interval in their study of mechanisms of WM for melodies. Li et al. (2013) and Siedenburg and McAdams (2016) used 6 s retention intervals in studies of nonverbal auditory WM. Though sounds may indeed engage WM processes immediately following perception, parallel access to ASM also may have influenced task performance in some studies that attempted to examined WM processes.</p>
        <p>Is this apparent oversight semantic or substantive?<anchor xml:id="a60"/> Some researchers may have equated WM with “short-term” memory in the most literal sense (i.e., without intending to differentiate ASM and active WM rehearsal), as memory terminology has been used ambiguously in the literature (see Cowan, 2008 ). Yet research procedures that purport to examine active mechanisms of rehearsal and maintenance in nonverbal WM seem to face a substantive interpretive challenge when the contributions of ASM are overlooked. <anchor xml:id="a61"/>With brief retention intervals, some memory tasks may be accomplished using ASM—a different construct from WM altogether.<anchor xml:id="a62"/></p>
        <p>This ambiguity is especially problematic when interfering tasks or stimuli are introduced during the retention interval of two-stimulus comparison tasks to infer mechanisms of active rehearsal in WM. According to the logic of these paradigms, a secondary task that requires the same WM mechanism as rehearsal of the sound will reduce memory performance (see Heuer, 1996 ). Lack of interference indicates the mechanism of the secondary task is not involved in WM for the sound stimuli. As a representative example, articulatory suppression (i.e., repeating an irrelevant word or syllable) has been used during retention intervals to examine the extent to which articulation is involved in rehearsal of nonverbal sounds. In a recent application of this paradigm by Soemer and Saito (2015) , participants heard two, three, or four abstract sounds (discriminable by timbre) followed by a retention interval (either 3 s or 12 s). Participants then indicated if a single probe was one of the initial sounds. Articulatory suppression (repeating “da” aloud) was used during the retention interval. Results showed no effects of articulatory suppression compared to a control condition, except for two-item lists 2 . <anchor xml:id="a63"/>Using a similar procedure with a retention interval of 6 s, however, Siedenburg and McAdams (2016) reported that articulatory suppression did impair memory performance compared to a control condition.<anchor xml:id="a64"/> Both studies attempted to draw conclusions about mechanisms of active maintenance in WM. Since we do not have a precise estimate of the duration of ASM, performance arguably could have reflected ASM, WM rehearsal, or some combination of both, especially with a 3 s retention interval and perhaps even with a 6 s interval. <anchor xml:id="a65"/>Even when the WM rehearsal mechanism for a stimulus has been blocked, task performance may remain partially or even fully intact due to contributions from ASM (e.g., McKeown et al., 2011 ).<anchor xml:id="a66"/> In this case, an observed lack of interference could erroneously suggest that the interference task did not require the same WM mechanism as retention of the stimulus.</p>
        <p>Advancing Theories of Nonverbal Auditory WM</p>
        <p>Discrepant findings like those discussed above have led to a range of theoretical perspectives on the active processing (e.g., rehearsal) of nonverbal sounds in WM. <anchor xml:id="a67"/>Researchers have suggested WM for nonverbal sounds is accomplished by: (1) the phonological loop of verbal WM ( Baddeley and Logie, 1992 ); (2) an independent “music memory loop” ( Berz, 1995 ); (3) attention ( Siedenburg and McAdams, 2016 ); and (4) different mechanisms for pitch versus timbre ( Soemer and Saito, 2015 ).<anchor xml:id="a68"/> Further, some (e.g., Demany and Semal, 2008 ) have even suggested that rehearsal of nonverbal auditory stimuli is not possible. These disparate proposals indicate an area in need of more research that focuses intensively on theory-building. A successful theory of the mechanism of WM for nonverbal sounds will need to differentiate ASM from WM.</p>
        <p>To reveal the properties of a WM rehearsal mechanism for nonverbal sounds, ASM’s effects should be minimized in studies that purport to assess rehearsal. <anchor xml:id="a69"/>The indeterminate duration of ASM precludes recommending a definitive retention interval duration that would eliminate contributions of ASM.<anchor xml:id="a70"/> <anchor xml:id="a71"/>To complicate the matter further, evidence has suggested that the duration of ASM is subject to considerable individual differences (e.g., Kubovy and Howard, 1976 ).<anchor xml:id="a72"/> Clearly, longer retention intervals will be less likely to allow for ASM to contribute to performance on tasks for which the target construct is WM. <anchor xml:id="a73"/>Intervals of less than 5 s are well within the persistence of many estimates of the behavioral life of ASM, whereas intervals of 8–10 s or more begin to exceed the duration of many, but not all, estimates of the duration of ASM.<anchor xml:id="a74"/></p>
        <p>Elimination of the ASM trace with irrelevant auditory stimuli may offer another solution. Some researchers have appended an irrelevant sound following the presentation of to-be-remembered sounds in an attempt to overwrite the ASM trace. <anchor xml:id="a75"/>Soemer and Saito used a 200 ms burst of white noise following their to-be-remembered stimuli.<anchor xml:id="a76"/> Li et al. (2013) used a 500 ms composite sound—all 12 test tones in their experiment presented concurrently. Although this approach makes sense intuitively, care must be taken to ensure that these post-stimulus masks actually overwrite ASM. <anchor xml:id="a77"/>The auditory version of the suffix effect—whereby memory for the last few items in auditory serial lists is impaired by presentation of a post-list sound—has been taken to reflect interference in ASM<anchor xml:id="a78"/> (for a detailed review, see Penney, 1989 ) 3 . The suffix effect has been studied extensively in verbal WM, and some studies have examined the effect for nonverbal auditory stimuli. Interference by a suffix depends upon the acoustic similarity between the suffix and its preceding stimulus (e.g., Morton et al., 1971 ; Rowe and Rowe, 1976 ). <anchor xml:id="a79"/>Greene and Samuel (1986) showed that white noise did not result in a suffix effect for verbal digits or non-speech tones, which casts doubt on the effectiveness of white noise as a stimulus that overwrites ASM.<anchor xml:id="a80"/> Interestingly, they also showed that a speech suffix and a non-speech chord suffix both seemed to overwrite ASM for tones, but only speech showed a suffix effect for digits. <anchor xml:id="a81"/>Overwriting in ASM requires more research, but without definitive empirical evidence, it seems unwarranted to assume that a noise burst or a composite stimulus will eliminate contributions of ASM to WM tasks.<anchor xml:id="a82"/></p>
        <p>Attempts to develop a response modality that permits recall (rather than recognition) tasks with nonverbal auditory stimuli also could be useful. As has been the case with verbal WM, recall of lists of nonverbal auditory stimuli could perhaps reveal patterns of serial position errors that differentiate WM rehearsal from ASM. The difficulty is that common response modalities create task demands that encourage participants to translate sounds into a different memory code, which may defeat the goal of examining memory for sounds per se . Researchers have devised creative approaches to nonverbal auditory memory tasks to circumvent this problem (e.g., Kumar et al., 2013 ), but more research is needed on this topic.</p>
        <p>Finally, cognitive neuroscience approaches could help to clarify the relative contributions of ASM and WM to performance of auditory memory tasks. Research has suggested that behavioral performance that correlates with the MMN would likely reflect memory contributions from ASM ( Näätänen, 2000 ; Schröger, 2007 ), whereas performance that correlates with alpha oscillations would reflect contributions from maintenance processes in WM (see Lim et al., 2015 ).</p>
        <p>Conclusion</p>
        <p>Discrepant findings have hindered the development of theory regarding mechanisms of rehearsal in nonverbal auditory WM. Procedures that conflate ASM with WM may be one potential contributor to disparate results. <anchor xml:id="a83"/>Task demands established by methodological decisions about the duration of the retention interval in two-stimulus comparison tasks may have allowed for ASM to affect results that have been attributed to rehearsal in WM.<anchor xml:id="a84"/> A viable theory of nonverbal auditory WM will need to explain the relationship between ASM and WM. A renewed focus on this relationship and the potential role of ASM in performance of WM tasks may be valuable in this regard.</p>
        <p>Author Contributions</p>
        <p>The author confirms being the sole contributor of this work and approved it for publication.</p>
        <p>Conflict of Interest Statement</p>
        <p>The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
        <p>Funding. During preparation of this submission, the author was supported by a Richard King Mellon Foundation Summer Research Fellowship awarded by the Lafayette College Academic Research Committee.</p>
        <p>1 For simplicity, ASM is shown terminating discretely in Figure 1 . Research has shown the sensory trace has a half-life (e.g., Kubovy and Howard, 1976 ), which suggests that the trace decays as a function of time (see, e.g., McKeown and Mercer, 2012 ).</p>
        <p>2 Their graphical results (their Figure 1, upper right) suggested a trend toward an interaction such that suppression had a detrimental effect at 12 s but not 3 s, but the statistical analysis of that interaction was not reported.</p>
        <p>3 Penney (1989 , pp. 403–404) viewed suffix effects as a family of short-term memory phenomena, with the auditory version attributable to ASM.<anchor xml:id="a85"/></p>
    </body>
  </text>
</TEI>
