NeespersName (2016date). “Have We Forgotten Auditory Sensory Memory? Retention Intervals in Studies of Nonverbal Auditory Working Memory.” Frontiers in Psychologytitle·j.
Object of study — The retention intervalsterm·mth used in nonverbal auditory working-memory experiments, and whether they are long enough to exclude auditory sensory memoryterm·dom.
Research question — When a study reports working memoryterm·dom for a nonverbal sound after a few seconds, is it measuring working memoryterm·dom at all, or the sensory trace that persists alongside it?
Contribution — Shows that the conventional 3-5 s retention intervalterm·mth does not exclude auditory sensory memoryterm·dom, so a body of findings attributed to working memoryterm·dom is ambiguous between two constructs.
phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text| phenomenon | nonverbal auditory working memory — “Researchers have shown increased interest in mechanisms of working memory for nonverbal sounds such as music and environmental sounds.” | |
| claim-type | critique — “Unlike verbal working memory studies that use serial recall tasks, research paradigms for exploring nonverbal working memory—especially two-stimulus comparison tasks—may not be differentiating working memory from sensory memory processes in analyses of behavioral responses, because retention interval durations have not excluded the possibility that the sensory memory trace drives task performance.” | |
| method — evidence | — “This assumption is examined in detail in this comment.” | |
| object of study — evidence | — “two sounds separated by a brief retention interval (often 3–5 s) are compared, and a “same” or “different” judgment is recorded” | |
| research question — evidence | — “The retention interval must extend beyond the persistence of ASM to isolate WM processes, because information about the most recently heard stimulus is simultaneously available to both ASM and WM (e.g., rehearsal) processes.” | |
| contribution — evidence | — “This conflation of different constructs may be one contributor to discrepant research findings and the resulting proliferation of theoretical conjectures regarding mechanisms of working memory for nonverbal sounds.” | |
| mechanism | during a short retention interval the lingering sensory trace and the rehearsed working-memory trace remain available in parallel, so the participant can answer from either, and the experimenter cannot attribute performance to one store — “With Retention Interval A, the participant could consult either the lingering ASM trace 1 or the rehearsed WM trace to decide whether the standard and comparison stimuli are the same or different; both memory traces exist in parallel.” | mechanisms[0] |
| mechanism | sensory memory keeps task performance intact when rehearsal is blocked, so a genuinely interfering secondary task can still yield a null result that is then misread as showing the two tasks use different mechanisms — “Even when the WM rehearsal mechanism for a stimulus has been blocked, task performance may remain partially or even fully intact due to contributions from ASM (e.g., McKeown et al., 2011 ).” | mechanisms[1] |
| mechanism | the two memories run in parallel, so while the sensory trace survives, either one can drive the response and the experiment cannot tell which did — “The retention interval must extend beyond the persistence of ASM to isolate WM processes, because information about the most recently heard stimulus is simultaneously available to both ASM and WM (e.g., rehearsal) processes.” | mechanisms[2] |
| mechanism | the convention arose from an early estimate that the sensory trace lasted about two seconds, which later work did not support — “Researchers initially speculated that the maximum duration of the ASM trace was about 2 s or less (e.g., Neisser, 1967 ; Crowder, 1976 ), which suggested that negligible contributions of ASM to memory performance could be assumed when intervals exceeded 2 s.” | mechanisms[3] |
| mechanism | the verbal literature escaped the problem because serial recall lets primacy and recency separate rehearsal from the sensory trace; nonverbal sounds cannot be recalled aloud, so that separation is unavailable — “Nonverbal sounds typically are not amenable to recall tasks, because participants would need to respond verbally” | mechanisms[4] |
| contradicts | Golubock and Janata (2013) — “Golubock and Janata (2013) defined retention of a sound for as brief as 1 s following stimulation as a WM task.” | claim_relations[0] |
| contradicts | Soemer and Saito (2015) — “Using retention intervals as brief as 3 s, Soemer and Saito (2015) likewise implied that the retention of a sound for any duration following stimulation must be accomplished by an active WM maintenance mechanism (also see Schulze et al., 2012 ). Schendel and Palmer (2007) used a 4.2 s retention interval in their study of mechanisms of WM for melodies. Li et al. (2013) and Siedenburg and McAdams (2016) used 6 s retention intervals in studies of nonverbal auditory WM. Though sounds may indeed engage WM processes immediately following perception, parallel access to ASM also may have influenced task performance in some studies that attempted to examined WM processes. Is this apparent oversight semantic or substantive?” | claim_relations[1] |
| contradicts | studies treating any post-stimulus retention as working memory, e.g. Golubock and Janata (2013) — “Golubock and Janata (2013) defined retention of a sound for as brief as 1 s following stimulation as a WM task.” | claim_relations[2] |
| builds-on | Schröger's (2007) review of mismatch negativity studies — “In a review of MMN studies, Schröger (2007) concluded that ASM may endure up to 20 s or longer.” | claim_relations[3] |
| builds-on | Atkinson and Shiffrin's (1968) three-store memory model — “Atkinson and Shiffrin’s (1968) influential memory model described a sensory register , a short-term store , and a long-term store .” | claim_relations[4] |
| sense | memory - the passive sensory kind: a high-resolution trace of what was just heard, not manipulable and not under attentional control — “Thus, ASM is a passive store of just-heard sounds that retains a “synthesized auditory memory” ( Massaro, 1975 )” | senses[0] |
| sense | memory - the working kind: active manipulation, rehearsal and reinstatement, able to run without any sound having been heard — “These “working” aspects of WM— active mental manipulation, rehearsal, and reinstatement of information— represent an important functional distinction between WM and ASM.” | senses[1] |
| sense | short-term memory - used loosely as a synonym for working memory, which the paper identifies as part of how the two constructs got conflated — “Auditory sensory memory is qualitatively different from post-sensory memory processes ( Massaro, 1972 ; Crowder, 1982 ), including Atkinson and Shiffrin’s short-term store, which evolved into the working memory (WM) construct (see, e.g., Logie and Cowan, 2015 ).” | senses[2] |
| edge | echoic memory —same-as→ auditory sensory memory — “Neisser (1967) dubbed the auditory sensory store echoic memory —a term synonymous with auditory sensory memory (ASM).” | concept_edges[0] |
| audit | short-term store —renamed-across-fields→ working memory — Audit 2026-09-28: DOUBTFUL - read against its span and kept, but the short-term store EVOLVED INTO working memory within one field; renamed-across-fields overstates it. — “Auditory sensory memory is qualitatively different from post-sensory memory processes ( Massaro, 1972 ; Crowder, 1982 ), including Atkinson and Shiffrin’s short-term store, which evolved into the working memory (WM) construct (see, e.g., Logie and Cowan, 2015 ).” | concept_edges[1] |
| note | short-term store —renamed-across-fields→ working memory — the quote says the short-term store EVOLVED INTO the working memory construct - a succession over time, not an identity. retyped 2026-08-12 after the same-as transitivity audit. renamed-across-fields is the closest of the eight types but it is wrong in the detail: this is diachronic within one field, not across fields. Cowan2008 in this same corpus spends its length distinguishing the two. — “Auditory sensory memory is qualitatively different from post-sensory memory processes ( Massaro, 1972 ; Crowder, 1982 ), including Atkinson and Shiffrin’s short-term store, which evolved into the working memory (WM) construct (see, e.g., Logie and Cowan, 2015 ).” | concept_edges[1] |
| weight | short-term store —renamed-across-fields→ working memory — 0.7 — “Auditory sensory memory is qualitatively different from post-sensory memory processes ( Massaro, 1972 ; Crowder, 1982 ), including Atkinson and Shiffrin’s short-term store, which evolved into the working memory (WM) construct (see, e.g., Logie and Cowan, 2015 ).” | concept_edges[1] |
| edge | auditory sensory memory —distinct-from→ working memory — “With brief retention intervals, some memory tasks may be accomplished using ASM—a different construct from WM altogether.” | concept_edges[2] |
| edge | auditory sensory memory —operationalised-as→ mismatch negativity — “The widely researched mismatch negativity (MMN) component (see Näätänen, 2000 ) of evoked neural responses to sounds offers a metric of the duration of ASM.” | concept_edges[3] |
| edge | rehearsal —part-of→ working memory — “These “working” aspects of WM— active mental manipulation, rehearsal, and reinstatement of information— represent an important functional distinction between WM and ASM.” | concept_edges[4] |
| weight | two-stimulus comparison tasks —contrasted-with→ serial recall — 0.9 — “Unlike verbal working memory studies that use serial recall tasks, research paradigms for exploring nonverbal working memory—especially two-stimulus comparison tasks—may not be differentiating working memory from sensory memory processes in analyses of behavioral responses, because retention interval durations have not excluded the possibility that the sensory memory trace drives task performance.” | concept_edges[5] |
| for which use | limitation — any recommendation of a retention interval: THE INDETERMINATE DURATION OF ASM PRECLUDES RECOMMENDING A DEFINITIVE RETENTION INTERVAL DURATION THAT WOULD ELIMINATE CONTRIBUTIONS OF ASM — “The indeterminate duration of ASM precludes recommending a definitive retention interval duration that would eliminate contributions of ASM.” | limitations[0] |
| for which use | limitation — the overwriting remedy: WITHOUT DEFINITIVE EMPIRICAL EVIDENCE, IT SEEMS UNWARRANTED TO ASSUME THAT A NOISE BURST OR A COMPOSITE STIMULUS WILL ELIMINATE CONTRIBUTIONS OF ASM TO WM TASKS — “Overwriting in ASM requires more research, but without definitive empirical evidence, it seems unwarranted to assume that a noise burst or a composite stimulus will eliminate contributions of ASM to WM tasks.” | limitations[1] |
| for which use | limitation — every duration-based argument in the comment: RESEARCH HAS SHOWN STRIKING VARIATION IN THE ESTIMATED DURATION OF ASM — “Research has shown striking variation in the estimated duration of ASM.” | limitations[3] |
| replication | untested | |
| limitation | The paper cannot prescribe a retention-interval duration that would definitively remove auditory sensory memory, because estimates of that memory's duration vary too widely. — “The indeterminate duration of ASM precludes recommending a definitive retention interval duration that would eliminate contributions of ASM.” | limitations[0] |
| limitation | The alternative remedy the paper discusses - overwriting the sensory trace with an irrelevant sound - lacks the empirical evidence needed to justify assuming it works. — “Overwriting in ASM requires more research, but without definitive empirical evidence, it seems unwarranted to assume that a noise burst or a composite stimulus will eliminate contributions of ASM to WM tasks.” | limitations[1] |
| limitation | The paper is a commentary: it identifies an interpretive ambiguity and does not measure how much of any published effect is actually sensory. — “Researchers seem to have assumed that sensory memory has a negligible impact on performance in auditory two-stimulus comparison tasks. This assumption is examined in detail in this comment.” | limitations[2] |
| limitation | The critique rests on duration estimates that themselves vary by a factor of thirty, so it cannot say which interval would be long enough. — “Research has shown striking variation in the estimated duration of ASM.” | limitations[3] |
finding · quantity · variable · definition · key-term — grounded in the full text| finding | The retention intervals conventionally used in nonverbal auditory two-stimulus comparison tasks may have let sensory memory affect results attributed to working-memory rehearsal. — “Task demands established by methodological decisions about the duration of the retention interval in two-stimulus comparison tasks may have allowed for ASM to affect results that have been attributed to rehearsal in WM.” | content_tags.findings[0] |
| finding | Published estimates of the duration of the auditory sensory trace disagree enormously, running from 2 s or less through 3.5 s, 4-5 s, 10 s, 10-15 s, 20 s and 30 s up to possibly 60 s. — “Though some researchers have estimated it to be 2 s or less ( Crowder, 1976 ; Huron and Parncutt, 1993 ), longer estimates have included 3.5 s ( Mcevoy et al., 1997 ), 4–5 s ( Glucksberg and Cowen, 1970 ), at least several seconds ( Cowan, 1984 ), 10 s ( Sams et al., 1993 ), 10–15 s ( Winkler and Cowan, 2005 ), 20 s ( Watkins and Todres, 1980 ), at least 30 s ( Winkler et al., 2002 ), and possibly up to 60 s ( Engle and Roberts, 1982 ).” | content_tags.findings[1] |
| finding | Retention intervals under 5 s fall within many published estimates of sensory-memory persistence, while intervals of 8-10 s or more begin to exceed many, but not all, of them. — “Intervals of less than 5 s are well within the persistence of many estimates of the behavioral life of ASM, whereas intervals of 8–10 s or more begin to exceed the duration of many, but not all, estimates of the duration of ASM.” | content_tags.findings[2] |
| finding | The duration of auditory sensory memory appears subject to considerable individual differences. — “To complicate the matter further, evidence has suggested that the duration of ASM is subject to considerable individual differences (e.g., Kubovy and Howard, 1976 ).” | content_tags.findings[3] |
| finding | White noise produced no suffix effect for digits or tones, which casts doubt on white noise as a stimulus that overwrites sensory memory. — “Greene and Samuel (1986) showed that white noise did not result in a suffix effect for verbal digits or non-speech tones, which casts doubt on the effectiveness of white noise as a stimulus that overwrites ASM.” [ATTRIBUTED TO A CITED AUTHOR, NOT THIS PAPER] the paper’s own words: “Greene and Samuel (1986) showed” | content_tags.findings[4] |
| finding | With a 6 s retention interval, articulatory suppression impaired memory for nonverbal sounds relative to a control condition. — “Using a similar procedure with a retention interval of 6 s, however, Siedenburg and McAdams (2016) reported that articulatory suppression did impair memory performance compared to a control condition.” [ATTRIBUTED TO A CITED AUTHOR, NOT THIS PAPER] the paper’s own words: “Siedenburg and McAdams (2016) reported” | content_tags.findings[5] |
| finding | Verbal serial recall separates the two stores by serial position - primacy indexes rehearsal in working memory and auditory recency indexes sensory memory. — “Analysis of memory for each list position permits dissociations of performance driven by WM rehearsal processes (e.g., primacy effects—recall advantages in the early portion of lists due to extended rehearsal time) from performance driven by ASM (e.g., auditory recency—better recall for the last few items with auditory presentation).” | content_tags.findings[6] |
| finding | Four mechanisms have been proposed for working memory of nonverbal sounds: the verbal phonological loop, a separate music memory loop, attention, and different mechanisms for pitch versus timbre. — “Researchers have suggested WM for nonverbal sounds is accomplished by: (1) the phonological loop of verbal WM ( Baddeley and Logie, 1992 ); (2) an independent “music memory loop” ( Berz, 1995 ); (3) attention ( Siedenburg and McAdams, 2016 ); and (4) different mechanisms for pitch versus timbre ( Soemer and Saito, 2015 ).” | content_tags.findings[7] |
| finding | The comment proposes that conflating sensory memory with working memory may be one contributor to the field's discrepant findings and its proliferation of theories. — “This conflation of different constructs may be one contributor to discrepant research findings and the resulting proliferation of theoretical conjectures regarding mechanisms of working memory for nonverbal sounds.” | content_tags.findings[8] |
| finding | Estimates of how long auditory sensory memory lasts range from 2 seconds or less to possibly 60. — “Though some researchers have estimated it to be 2 s or less ( Crowder, 1976 ; Huron and Parncutt, 1993 ), longer estimates have included 3.5 s ( Mcevoy et al., 1997 ), 4–5 s ( Glucksberg and Cowen, 1970 ), at least several seconds ( Cowan, 1984 ), 10 s ( Sams et al., 1993 ), 10–15 s ( Winkler and Cowan, 2005 ), 20 s ( Watkins and Todres, 1980 ), at least 30 s ( Winkler et al., 2002 ), and possibly up to 60 s ( Engle and Roberts, 1982 ).” | content_tags.findings[9] |
| finding | A review of MMN studies concluded that the auditory sensory trace may endure up to 20 seconds or longer. — “In a review of MMN studies, Schröger (2007) concluded that ASM may endure up to 20 s or longer.” [ATTRIBUTED TO A CITED AUTHOR, NOT THIS PAPER] the paper’s own words: “Schröger (2007) concluded” | content_tags.findings[10] |
| finding | Published studies have called retention of a sound 'working memory' after intervals as short as one second. — “Golubock and Janata (2013) defined retention of a sound for as brief as 1 s following stimulation as a WM task.” | content_tags.findings[11] |
| finding | The verbal working-memory literature did separate the two contributions; the nonverbal literature did not. — “Thus, in the verbal WM literature, the respective contributions of WM rehearsal and ASM have been disentangled in empirical investigations and their accompanying theoretical interpretations (see Jones et al., 2004 , 2006 ).” | content_tags.findings[12] |
| quantity | 3–5 s — the brief retention interval typically separating the two sounds in these comparison tasks — “These studies often have used two-stimulus comparison tasks: two sounds separated by a brief retention interval (often 3–5 s) are compared, and a “same” or “different” judgment is recorded.” | content_tags.quantities[0] |
| quantity | 2 s — the maximum sensory-trace duration originally assumed, which licensed treating any longer interval as sensory-memory-free — “Researchers initially speculated that the maximum duration of the ASM trace was about 2 s or less (e.g., Neisser, 1967 ; Crowder, 1976 ), which suggested that negligible contributions of ASM to memory performance could be assumed when intervals exceeded 2 s.” | content_tags.quantities[1] |
| quantity | 20 s — the sensory-memory duration a review of mismatch-negativity studies concluded was possible — “In a review of MMN studies, Schröger (2007) concluded that ASM may endure up to 20 s or longer.” [ATTRIBUTED TO A CITED AUTHOR, NOT THIS PAPER] the paper’s own words: “Schröger (2007) concluded” | content_tags.quantities[2] |
| quantity | 5 s — the retention interval used in the seminal tonal-memory studies that set the convention — “For example, Deutsch’s seminal studies of tonal memory (reviewed in Deutsch, 1975 ) used 5 s retention intervals.” | content_tags.quantities[3] |
| quantity | 1 s — the shortest post-stimulus retention that a recent study still labelled a working-memory task — “Golubock and Janata (2013) defined retention of a sound for as brief as 1 s following stimulation as a WM task.” | content_tags.quantities[4] |
| quantity | 200 ms — duration of the white-noise burst used as a post-stimulus mask intended to overwrite the sensory trace — “Soemer and Saito used a 200 ms burst of white noise following their to-be-remembered stimuli.” | content_tags.quantities[5] |
| quantity | 8–10 s — the interval length at which retention begins to exceed most estimates of sensory-memory persistence — “Intervals of less than 5 s are well within the persistence of many estimates of the behavioral life of ASM, whereas intervals of 8–10 s or more begin to exceed the duration of many, but not all, estimates of the duration of ASM.” | content_tags.quantities[6] |
| quantity | 3–5 s — the conventional retention interval in two-stimulus comparison tasks - the number the critique is about — “two sounds separated by a brief retention interval (often 3–5 s) are compared, and a “same” or “different” judgment is recorded” | content_tags.quantities[7] |
| quantity | 2 s to 60 s — the full range of published estimates for the duration of auditory sensory memory — “Though some researchers have estimated it to be 2 s or less ( Crowder, 1976 ; Huron and Parncutt, 1993 ), longer estimates have included 3.5 s ( Mcevoy et al., 1997 ), 4–5 s ( Glucksberg and Cowen, 1970 ), at least several seconds ( Cowan, 1984 ), 10 s ( Sams et al., 1993 ), 10–15 s ( Winkler and Cowan, 2005 ), 20 s ( Watkins and Todres, 1980 ), at least 30 s ( Winkler et al., 2002 ), and possibly up to 60 s ( Engle and Roberts, 1982 ).” | content_tags.quantities[8] |
| quantity | 20 s or longer — duration of the sensory trace as estimated from mismatch negativity studies — “In a review of MMN studies, Schröger (2007) concluded that ASM may endure up to 20 s or longer.” [ATTRIBUTED TO A CITED AUTHOR, NOT THIS PAPER] the paper’s own words: “Schröger (2007) concluded” | content_tags.quantities[9] |
| quantity | 1 s — the shortest interval a published study has called working memory — “Golubock and Janata (2013) defined retention of a sound for as brief as 1 s following stimulation as a WM task.” | content_tags.quantities[10] |
| variable | retention interval (independent) — “two sounds separated by a brief retention interval (often 3–5 s) are compared, and a “same” or “different” judgment is recorded” | content_tags.variables[0] |
| definition | working memory (WM) — “processes ( Massaro, 1972 ; Crowder, 1982 ), including Atkinson and Shiffrin’s short-term store, which evolved into the working memory (WM) construct (see, e.g., Logie and Cowan, 2015 ). WM receives input from sensory memory about recent perceptual experiences, maintains and manipulates information during in-progress cognitive activities, and interfaces with long-term memory to reinstate information from the latent, permanent corpus of previous experiences.” | content_tags.definitions[3] |
| definition | two-stimulus comparison task — “These studies often have used two-stimulus comparison tasks: two sounds separated by a brief retention interval (often 3–5 s) are compared, and a “same” or “different” judgment is recorded.” | content_tags.definitions[4] |
| definition | retention interval — “The duration of the retention interval—the time during which the initial sound must be remembered—typically has been a few seconds.” | content_tags.definitions[5] |
| definition | suffix effect — “The auditory version of the suffix effect—whereby memory for the last few items in auditory serial lists is impaired by presentation of a post-list sound—has been taken to reflect interference in ASM” | content_tags.definitions[6] |
| definition | echoic memory — “Neisser (1967) dubbed the auditory sensory store echoic memory —a term synonymous with auditory sensory memory (ASM).” | content_tags.definitions[7] |
| definition | auditory sensory memory — “Thus, ASM is a passive store of just-heard sounds that retains a “synthesized auditory memory” ( Massaro, 1975 )” | content_tags.definitions[8] |
| key-terms | auditory sensory memory, echoic memory, working memory, short-term store, sensory register, long-term store, retention interval, two-stimulus comparison tasks, mismatch negativity, rehearsal, serial recall, auditory imagery |
| concept | auditory sensory memory — not defined in this paper's own words; a passive, modality-specific, high-resolution store of just-heard sounds, of limited duration and independent of attention — “Thus, ASM is a passive store of just-heard sounds that retains a “synthesized auditory memory” ( Massaro, 1975 )” | concepts[0] |
| concept | echoic memory — not defined in this paper's own words; Neisser's name for the auditory sensory store; the paper states it is synonymous with auditory sensory memory — “Neisser (1967) dubbed the auditory sensory store echoic memory —a term synonymous with auditory sensory memory (ASM).” | concepts[1] |
| concept | working memory — not defined in this paper's own words; the active store that manipulates, rehearses and reinstates information, and interfaces with long-term memory — “These “working” aspects of WM— active mental manipulation, rehearsal, and reinstatement of information— represent an important functional distinction between WM and ASM.” | concepts[2] |
| concept | short-term store — not defined in this paper's own words; Atkinson and Shiffrin's term, which the paper says became the working memory construct — “Auditory sensory memory is qualitatively different from post-sensory memory processes ( Massaro, 1972 ; Crowder, 1982 ), including Atkinson and Shiffrin’s short-term store, which evolved into the working memory (WM) construct (see, e.g., Logie and Cowan, 2015 ).” | concepts[3] |
| concept | sensory register — not defined in this paper's own words; the first of the three stores in the Atkinson and Shiffrin model — “Atkinson and Shiffrin’s (1968) influential memory model described a sensory register , a short-term store , and a long-term store .” | concepts[4] |
| concept | retention interval — not defined in this paper's own words; the gap between the two sounds during which the first must be held - the parameter that decides which memory the task measures — “two sounds separated by a brief retention interval (often 3–5 s) are compared, and a “same” or “different” judgment is recorded” | concepts[5] |
| concept | two-stimulus comparison tasks — not defined in this paper's own words; the standard nonverbal paradigm: hear a sound, wait, hear another, judge same or different — “These studies often have used two-stimulus comparison tasks: two sounds separated by a brief retention interval (often 3–5 s) are compared, and a “same” or “different” judgment is recorded” | concepts[6] |
| concept | serial recall — not defined in this paper's own words; the verbal paradigm in which list position lets rehearsal effects be separated from sensory ones — “Auditory verbal WM often has been studied using serial recall tasks. Participants hear a list of words, letters, or digits, then immediately write or speak aloud all of the items. Analysis of memory for each list position permits dissociations of performance driven by WM rehearsal processes (e.g., primacy effects—recall advantages in the early portion of lists due to extended rehearsal time) from performance driven by ASM (e.g., auditory recency—better recall for the last few items with auditory presentation). Thus, in the verbal WM literature, the respective contributions of WM rehearsal and ASM have been disentangled in empirical investigations and their accompanying theoretical interpretations (see Jones et al., 2004 , 2006 ).” | concepts[7] |
| concept | mismatch negativity — not defined in this paper's own words; an evoked neural response used as a measure of how long the auditory sensory trace lasts — “The widely researched mismatch negativity (MMN) component (see Näätänen, 2000 ) of evoked neural responses to sounds offers a metric of the duration of ASM.” | concepts[8] |
| concept | rehearsal — not defined in this paper's own words; the active maintenance process that belongs to working memory and not to the sensory store — “ASM does not involve active manipulation or rehearsal (see, especially, Green and McKeown, 2007 , Experiment 2; also see McKeown and Mercer, 2012 ) and is insensitive to attentional processes” | concepts[9] |
| concept | auditory imagery — not defined in this paper's own words; a sound reinstated from long-term memory without being heard - possible for working memory, impossible for the sensory store — “Further, ASM is only engaged when a sound is heard, whereas WM for sounds can be initiated in the absence of hearing a stimulus (i.e., when a sound is reinstated from long-term memory, as in auditory imagery).” | concepts[10] |
| claim type | critique — a second reading reaching the same value; recorded: critique — “With brief retention intervals, some memory tasks may be accomplished using ASM—a different construct from WM altogether.” | alternatives.claim_type |
| method | conceptual-analysis — a second reading DIFFERING from the recorded value; recorded: review — “Researchers seem to have assumed that sensory memory has a negligible impact on performance in auditory two-stimulus comparison tasks. This assumption is examined in detail in this comment.” | alternatives.method |
| phenomenon | conflation of auditory sensory memory with working memory in two-stimulus comparison tasks — a second reading DIFFERING from the recorded value; recorded: nonverbal auditory working memory — “Interpretation of observed memory performance for Retention Interval A is ambiguous—participants’ memory performance could reflect the fidelity of the ASM trace, the fidelity of the representation rehearsed in WM, or some combination of information from both sources.” | alternatives.phenomenon |
Full text — tagged
The reference list is not part of the text we hold for this paper. Our copy was extracted from the publisher's page and the bibliography did not survive that extraction, so the article below ends before its references. Nothing has been removed by us.
Have We Forgotten Auditory Sensory Memoryterm·dom? Retention Intervalsterm·mth in Studies of Nonverbal Auditory Working Memoryterm·dom Michael A NeespersName Michael A NeespersName 1 Department of Psychology, Lafayette College, Easton, PA, USA 1, * 1 Department of Psychology, Lafayette College, Easton, PA, USA Edited by: Claude Alain, Rotman Research Institute, Canada Reviewed by: Jochen Kaiser, Goethe University Frankfurt, Germany; Jonas Obleser, University of Lübeck, Germany ✉ *Correspondence: Michael A. NeespersName, neesm@lafayette.edu ; neespersName.michael@gmail.com This article was submitted to Auditory Cognitive Neuroscience, a section of the journal Frontiers in Psychology Received 2016 Sep 23; Accepted 2016 Nov 17; Collection date 2016.
Copyright © 2016 NeespersName.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
PMCID: PMC5133429 PMID: 27994565 Abstract Researchers have shown increased interest in mechanisms of working memoryterm·dom for nonverbal sounds such as music and environmental sounds. These studies often have used two-stimulus comparison tasksterm·mth: two sounds separated by a brief retention intervalterm·mth (often 3–5 s) are compared, and a “same” or “different” judgment is recorded. Researchers seem to have assumed that sensory memory has a negligible impact on performance in auditory two-stimulus comparison tasksterm·mth. This assumption is examined in detail in this comment. According to seminal texts and recent research reports, sensory memory persists in parallel with working memoryterm·dom for a period of time following hearing a stimulus and can influence behavioral responses on memory tasks. Unlike verbal working memoryterm·dom studies that use serial recallterm·mth tasks, research paradigms for exploring nonverbal working memoryterm·dom—especially two-stimulus comparison tasksterm·mth—may not be differentiating working memoryterm·dom from sensory memory processes in analyses of behavioral responses, because retention intervalterm·mth durations have not excluded the possibility that the sensory memory trace drives task performance. This conflation of different constructs may be one contributor to discrepant research findings and the resulting proliferation of theoretical conjectures regarding mechanisms of working memoryterm·dom for nonverbal sounds.
Keywords: auditory sensory memoryterm·dom, working memoryterm·dom, auditory cognition, nonverbal sounds, music cognition Atkinson and Shiffrin’s (1968) influential memory model described a sensory registerterm·dom , a short-term storeterm·dom , and a long-term storeterm·key . Neisser (1967) dubbed the auditory sensory store echoic memoryterm·dom —a term synonymous with auditory sensory memoryterm·dom (ASM). Contemporary research has established that ASM is: (1) auditory modality-specific; (2) high in resolution, which seems to indicate storage of episodic rather than categorical or abstract information; (3) limited in duration; and (4) independent from attentional processes ( Näätänen et al., 1989 ; Winkler and Cowan, 2005 ). Thus, ASM is a passive store of just-heard sounds that retains a “synthesized auditory memory” ( Massaro, 1975 )—a set of acoustic features organized in time that can be consulted to complete behavioral tasks, including comparing sounds to one another (e.g., Crowder, 1982 ).
Auditory sensory memoryterm·dom is qualitatively different from post-sensory memory processes ( Massaro, 1972 ; Crowder, 1982 ), including Atkinson and Shiffrin’s short-term storeterm·dom, which evolved into the working memory (WM)term·def construct (see, e.g., Logie and Cowan, 2015 ). WM receives input from sensory memory about recent perceptual experiences, maintains and manipulates information during in-progress cognitive activities, and interfaces with long-term memory to reinstate information from the latent, permanent corpus of previous experiences. These “working” aspects of WM— active mental manipulation, rehearsalterm·dom, and reinstatement of information— represent an important functional distinction between WM and ASM. ASM does not involve active manipulation or rehearsalterm·dom (see, especially, Green and McKeown, 2007 , Experiment 2; also see McKeown and Mercer, 2012 ) and is insensitive to attentional processes ( Näätänen et al., 1989 ; Winkler and Cowan, 2005 ), including WM rehearsalterm·dom processes ( NeespersName and Best, 2013 ; NeespersName and Walker, 2013 ). Further, ASM is only engaged when a sound is heard, whereas WM for sounds can be initiated in the absence of hearing a stimulus (i.e., when a sound is reinstated from long-term memory, as in auditory imageryterm·dom).
ASM in Verbal Versus Nonverbal Auditory WM Tasks Contributions of ASM to task performance have been acknowledged in studies of WM for speech and language (i.e., verbal WM). Auditory verbal WM often has been studied using serial recallterm·mth tasks. Participants hear a list of words, letters, or digits, then immediately write or speak aloud all of the items. Analysis of memory for each list position permits dissociations of performance driven by WM rehearsalterm·dom processes (e.g., primacy effects—recall advantages in the early portion of lists due to extended rehearsalterm·dom time) from performance driven by ASM (e.g., auditory recency—better recall for the last few items with auditory presentation). Thus, in the verbal WM literature, the respective contributions of WM rehearsalterm·dom and ASM have been disentangled in empirical investigations and their accompanying theoretical interpretations (see Jones et al., 2004 , 2006 ).
Nonverbal sounds typically are not amenable to recall tasks, because participants would need to respond verbally (e.g., by labeling the sound, see Paivio et al., 1975 ; also see Kumar et al., 2013 for an exception). Thus, participants might rehearse the sounds in WM as their verbal labels rather than remembering the sounds per se . Instead of recall tasks, studies of nonverbal auditory WM often have used two-stimulus comparison tasksterm·mth (for a reviewterm·mth, see Cowan, 1984 ). Participants hear an initial sound and compare it to a second sound following a retention intervalterm·mth. The duration of the retention intervalterm·mth—the time during which the initial sound must be remembered—typically has been a few seconds. For example, Deutsch’s seminal studies of tonal memory (reviewed in Deutsch, 1975 ) used 5 s retention intervalsterm·mth. Intervals of a few seconds became conventional for several reasons. Memory performance declines over time ( Cowan et al., 1999 ), so the interval must be short enough to leave some memory intact over the short-term. To capture post-sensory processes, however, retention intervalsterm·mth must be long enough to exceed the duration of ASM. Researchers initially speculated that the maximum duration of the ASM trace was about 2 s or less (e.g., Neisser, 1967 ; Crowder, 1976 ), which suggested that negligible contributions of ASM to memory performance could be assumed when intervals exceeded 2 s. Further, practical considerations when implementing experimental procedures (e.g., participant fatigue or methods requiring a large number of trials) make shorter retention intervalsterm·mth attractive.
ASM and WM Occur in Parallel The retention intervalterm·mth must extend beyond the persistence of ASM to isolate WM processes, because information about the most recently heard stimulus is simultaneously available to both ASM and WM (e.g., rehearsalterm·dom) processes. Deutsch (1975 , p. 110) noted “…we can store nonverbal stimulus attributes over substantially longer time periods…It must be concluded that the sensory attributes of a stimulus survive in memory after verbal encoding, and that they continue to be retained in parallel with the verbal attributes.” Similar views on parallel access to ASM and WM were expressed in seminal memory texts ( Massaro, 1975 ; Crowder, 1976 ; Underwood, 1976 ).
Empirical findings have supported parallel representation in ASM and WM. NeespersName and Walker (2013) asked participants to encode two-note sound sounds with increasing or decreasing intervals, visual words (“increasing” or “decreasing”), or images (simple increasing or decreasing graphs). All stimulus forms indicated equivalent information: either an increasing or decreasing state. WM encoding strategies also were manipulated; participants were instructed to encode and rehearse the initial stimulus as either a sound (i.e., auditory imageryterm·dom), a word (verbal encoding), or an image (visual imagery). Following a 3 s retention intervalterm·mth, participants made a speeded same/different response to a second stimulus, which could be either a sound, a word, or an image. Response times to the second stimulus were examined across factorial combinations of initial stimulus format, encoding strategy, and response stimulus format. Results generally showed that participants responded faster when the format of the second stimulus matched the strategy with which they rehearsed the initial stimulus in WM, but results also showed an independent effect of the initial stimulus format. When the initial stimulus was a sound, participants were faster to respond when the second stimulus was also a sound, regardless of (i.e., collapsed across) the WM encoding strategy. No such compatibility between the stimulus formats was observed for the visually presented words or images. These findings demonstrated that the effects of ASM persisted in parallel with recoding in WM (also see NeespersName and Best, 2013 ).
Simultaneous representation in ASM and WM presents difficulties for isolating the construct of interest during performance of two-stimulus comparison tasksterm·mth. Figure 1 depicts two retention intervalsterm·mth following the offset of an auditory stimulus in a two-stimulus comparison taskterm·def. With Retention Intervalterm·mth A, the participant could consult either the lingering ASM trace 1 or the rehearsed WM trace to decide whether the standard and comparison stimuli are the same or different; both memory traces exist in parallel. With retention Intervalterm·mth B, ASM is no longer available when the comparison stimulus arrives; performance of the task must be accomplished using the rehearsed WM representation of the standard stimulus. Interpretation of observed memory performance for Retention Intervalterm·mth A is ambiguous—participants’ memory performance could reflect the fidelity of the ASM trace, the fidelity of the representation rehearsed in WM, or some combination of information from both sources.
FIGURE 1.
Hypothetical availability of the ASM trace for two different retention intervalsterm·mth .
As such, the attribution of task performance to WM mechanisms in two-stimulus comparison tasksterm·mth hinges on the assumption that the ASM trace does not survive the duration of the retention intervalterm·mth. This assumption may be questionable for brief retention intervalsterm·mth. Research has shown striking variation in the estimated duration of ASM. Though some researchers have estimated it to be 2 s or less ( Crowder, 1976 ; Huron and Parncutt, 1993 ), longer estimates have included 3.5 s ( Mcevoy et al., 1997 ), 4–5 s ( Glucksberg and Cowen, 1970 ), at least several seconds ( Cowan, 1984 ), 10 s ( Sams et al., 1993 ), 10–15 s ( Winkler and Cowan, 2005 ), 20 s ( Watkins and Todres, 1980 ), at least 30 s ( Winkler et al., 2002 ), and possibly up to 60 s ( Engle and Roberts, 1982 ).
ASM and WM in Cognitive Neuroscience Cognitive neuroscience research has corroborated parallel ASM and WM processes (e.g., Buchsbaum et al., 2005 ), and separate neurological markers have been identified for ASM and auditory WM processes. The widely researched mismatch negativityterm·mth (MMN) component (see Näätänen, 2000 ) of evoked neural responses to sounds offers a metric of the duration of ASM. In a reviewterm·mth of MMN studies, Schröger (2007) concluded that ASM may endure up to 20 s or longer. Regarding auditory WM, recent research ( Lim et al., 2015 ) showed that processes involving maintenance of sounds are indexed by oscillations that fall within the alpha range of frequencies in electroencephalography (EEG) recordings. Wilsch and Obleser (2016) suggested that the power fluctuations of alpha oscillations track top-down attentional processes that serve to maintain representations in WM, perhaps while simultaneously inhibiting incoming sensory input that could potentially interfere with maintenance (also see Zimmermann et al., 2016 ).
Forgetting Sensory Memory?
Despite evidence that ASM is distinct from WM and may persist for longer than a couple of seconds, results from two-stimulus comparison tasksterm·mth in studies of nonverbal auditory WM have been interpreted with indifference toward ASM. In recent research reports on nonverbal auditory stimuli, the term “WM” has been used to describe memory over any period of time whatsoever following hearing a sound. Golubock and Janata (2013) defined retention of a sound for as brief as 1 s following stimulation as a WM task. Using retention intervalsterm·mth as brief as 3 s, Soemer and Saito (2015) likewise implied that the retention of a sound for any duration following stimulation must be accomplished by an active WM maintenance mechanism (also see Schulze et al., 2012 ). Schendel and Palmer (2007) used a 4.2 s retention intervalterm·mth in their study of mechanisms of WM for melodies. Li et al. (2013) and Siedenburg and McAdams (2016) used 6 s retention intervalsterm·mth in studies of nonverbal auditory WM. Though sounds may indeed engage WM processes immediately following perception, parallel access to ASM also may have influenced task performance in some studies that attempted to examined WM processes.
Is this apparent oversight semantic or substantive? Some researchers may have equated WM with “short-term” memory in the most literal sense (i.e., without intending to differentiate ASM and active WM rehearsalterm·dom), as memory terminology has been used ambiguously in the literature (see Cowan, 2008 ). Yet research procedures that purport to examine active mechanisms of rehearsalterm·dom and maintenance in nonverbal WM seem to face a substantive interpretive challenge when the contributions of ASM are overlooked. With brief retention intervalsterm·mth, some memory tasks may be accomplished using ASM—a different construct from WM altogether.
This ambiguity is especially problematic when interfering tasks or stimuli are introduced during the retention intervalterm·mth of two-stimulus comparison tasksterm·mth to infer mechanisms of active rehearsalterm·dom in WM. According to the logic of these paradigms, a secondary task that requires the same WM mechanism as rehearsalterm·dom of the sound will reduce memory performance (see Heuer, 1996 ). Lack of interference indicates the mechanism of the secondary task is not involved in WM for the sound stimuli. As a representative example, articulatory suppression (i.e., repeating an irrelevant word or syllable) has been used during retention intervalsterm·mth to examine the extent to which articulation is involved in rehearsalterm·dom of nonverbal sounds. In a recent application of this paradigm by Soemer and Saito (2015) , participants heard two, three, or four abstract sounds (discriminable by timbre) followed by a retention intervalterm·mth (either 3 s or 12 s). Participants then indicated if a single probe was one of the initial sounds. Articulatory suppression (repeating “da” aloud) was used during the retention intervalterm·mth. Results showed no effects of articulatory suppression compared to a control condition, except for two-item lists 2 . Using a similar procedure with a retention intervalterm·mth of 6 s, however, Siedenburg and McAdams (2016) reported that articulatory suppression did impair memory performance compared to a control condition. Both studies attempted to draw conclusions about mechanisms of active maintenance in WM. Since we do not have a precise estimate of the duration of ASM, performance arguably could have reflected ASM, WM rehearsalterm·dom, or some combination of both, especially with a 3 s retention intervalterm·mth and perhaps even with a 6 s interval. Even when the WM rehearsalterm·dom mechanism for a stimulus has been blocked, task performance may remain partially or even fully intact due to contributions from ASM (e.g., McKeown et al., 2011 ). In this case, an observed lack of interference could erroneously suggest that the interference task did not require the same WM mechanism as retention of the stimulus.
Advancing Theories of Nonverbal Auditory WM Discrepant findings like those discussed above have led to a range of theoretical perspectives on the active processing (e.g., rehearsalterm·dom) of nonverbal sounds in WM. Researchers have suggested WM for nonverbal sounds is accomplished by: (1) the phonological loop of verbal WM ( Baddeley and Logie, 1992 ); (2) an independent “music memory loop” ( Berz, 1995 ); (3) attention ( Siedenburg and McAdams, 2016 ); and (4) different mechanisms for pitch versus timbre ( Soemer and Saito, 2015 ). Further, some (e.g., Demany and Semal, 2008 ) have even suggested that rehearsalterm·dom of nonverbal auditory stimuli is not possible. These disparate proposals indicate an area in need of more research that focuses intensively on theory-building. A successful theory of the mechanism of WM for nonverbal sounds will need to differentiate ASM from WM.
To reveal the properties of a WM rehearsalterm·dom mechanism for nonverbal sounds, ASM’s effects should be minimized in studies that purport to assess rehearsalterm·dom. The indeterminate duration of ASM precludes recommending a definitive retention intervalterm·mth duration that would eliminate contributions of ASM. To complicate the matter further, evidence has suggested that the duration of ASM is subject to considerable individual differences (e.g., Kubovy and Howard, 1976 ). Clearly, longer retention intervalsterm·mth will be less likely to allow for ASM to contribute to performance on tasks for which the target construct is WM. Intervals of less than 5 s are well within the persistence of many estimates of the behavioral life of ASM, whereas intervals of 8–10 s or more begin to exceed the duration of many, but not all, estimates of the duration of ASM.
Elimination of the ASM trace with irrelevant auditory stimuli may offer another solution. Some researchers have appended an irrelevant sound following the presentation of to-be-remembered sounds in an attempt to overwrite the ASM trace. Soemer and Saito used a 200 ms burst of white noise following their to-be-remembered stimuli. Li et al. (2013) used a 500 ms composite sound—all 12 test tones in their experiment presented concurrently. Although this approach makes sense intuitively, care must be taken to ensure that these post-stimulus masks actually overwrite ASM. The auditory version of the suffix effectterm·def—whereby memory for the last few items in auditory serial lists is impaired by presentation of a post-list sound—has been taken to reflect interference in ASM (for a detailed reviewterm·mth, see Penney, 1989 ) 3 . The suffix effectterm·def has been studied extensively in verbal WM, and some studies have examined the effect for nonverbal auditory stimuli. Interference by a suffix depends upon the acoustic similarity between the suffix and its preceding stimulus (e.g., Morton et al., 1971 ; Rowe and Rowe, 1976 ). Greene and Samuel (1986) showed that white noise did not result in a suffix effectterm·def for verbal digits or non-speech tones, which casts doubt on the effectiveness of white noise as a stimulus that overwrites ASM. Interestingly, they also showed that a speech suffix and a non-speech chord suffix both seemed to overwrite ASM for tones, but only speech showed a suffix effectterm·def for digits. Overwriting in ASM requires more research, but without definitive empirical evidence, it seems unwarranted to assume that a noise burst or a composite stimulus will eliminate contributions of ASM to WM tasks.
Attempts to develop a response modality that permits recall (rather than recognition) tasks with nonverbal auditory stimuli also could be useful. As has been the case with verbal WM, recall of lists of nonverbal auditory stimuli could perhaps reveal patterns of serial position errors that differentiate WM rehearsalterm·dom from ASM. The difficulty is that common response modalities create task demands that encourage participants to translate sounds into a different memory code, which may defeat the goal of examining memory for sounds per se . Researchers have devised creative approaches to nonverbal auditory memory tasks to circumvent this problem (e.g., Kumar et al., 2013 ), but more research is needed on this topic.
Finally, cognitive neuroscience approaches could help to clarify the relative contributions of ASM and WM to performance of auditory memory tasks. Research has suggested that behavioral performance that correlates with the MMN would likely reflect memory contributions from ASM ( Näätänen, 2000 ; Schröger, 2007 ), whereas performance that correlates with alpha oscillations would reflect contributions from maintenance processes in WM (see Lim et al., 2015 ).
Conclusion Discrepant findings have hindered the development of theory regarding mechanisms of rehearsalterm·dom in nonverbal auditory WM. Procedures that conflate ASM with WM may be one potential contributor to disparate results. Task demands established by methodological decisions about the duration of the retention intervalterm·mth in two-stimulus comparison tasksterm·mth may have allowed for ASM to affect results that have been attributed to rehearsalterm·dom in WM. A viable theory of nonverbal auditory WM will need to explain the relationship between ASM and WM. A renewed focus on this relationship and the potential role of ASM in performance of WM tasks may be valuable in this regard.
Author Contributions The author confirms being the sole contributor of this work and approved it for publication.
Conflict of Interest Statement The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Funding. During preparation of this submission, the author was supported by a Richard King Mellon Foundation Summer Research Fellowship awarded by the Lafayette College Academic Research Committee.
1 For simplicity, ASM is shown terminating discretely in Figure 1 . Research has shown the sensory trace has a half-life (e.g., Kubovy and Howard, 1976 ), which suggests that the trace decays as a function of time (see, e.g., McKeown and Mercer, 2012 ).
2 Their graphical results (their Figure 1, upper right) suggested a trend toward an interaction such that suppression had a detrimental effect at 12 s but not 3 s, but the statistical analysis of that interaction was not reported.
3 Penney (1989 , pp. 403–404) viewed suffix effectsterm·def as a family of short-term memory phenomena, with the auditory version attributable to ASM.