Klaus OberauerpersName (2019date). “Working Memory and Attention - A Conceptual Analysis and Review.” Journal of Cognitiontitle·j.
Object of study — the theoretical options for linking working memoryterm·dom and attentionterm·dom, and the evidence for each
Research question — what exactly is agreed when working memoryterm·dom and attentionterm·dom are said to be intimately linked
Contribution — a conceptual map separating attentionterm·dom as a resourceterm·key from attentionterm·dom as selection, and an assessment that only the storage-and-processing resourceterm·key version is well supported while WMterm·dom is by definition a form of attentionterm·dom
phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text| phenomenon | the close relation between working memory capacity and attention — “There is broad agreement that working memory is closely related to attention.” | |
| claim-type | critique — “This assumption has considerable empirical support but also significant weaknesses (for a review see Oberauer et al., 2016 ), so that researchers should not endorse it as a default.” | |
| method — evidence | — “The purpose of this review is to propose a map for organizing these theoretical options, delineate their implications, and to evaluate the evidence for each of them.” | |
| object of study — evidence | — “The purpose of this review is to propose a map for organizing these theoretical options, delineate their implications, and to evaluate the evidence for each of them.” | |
| research question — evidence | — “There is a broad consensus that working memory and attention are intimately linked ( Awh, Jonides, & Reuter-Lorenz, 1998 ; Baddeley, 1993 ; Chun, 2011 ; Cowan, 1995 ; Gazzaley & Nobre, 2012 ; Kane, Bleckley, Conway, & Engle, 2001 ; Kiyonaga & Egner, 2014 ; Oberauer, 2009 ; Olivers, 2008 ). But what is it that we agree upon?” | |
| contribution — evidence | — “Three versions of this idea have been proposed: Attention as a resource for storage and processing, a shared resource for perceptual attention and memory maintenance, and a resource for the control of attention. The first of these three is empirically well supported, but the other two are not.” | |
| mechanism | representations in WM WM controls attention and action by holding the representations that guide them, such as search templates and task sets; once established they act automatically. — “To conclude, I argue that WM plays a crucial role in controlling attention and action by holding the representations that guide attention and action. The control process consists of selecting these representations into WM – once they are established in WM, they have their influence on attention and action automatically” | mechanisms[0] |
| sense | attention - as a resource: a continuous quantity that can be split arbitrarily and allotted to different processes depending on task demands — “The idea of attention as a resource is that the cognitive system has a limited resource that can be used for carrying out so-called attention-demanding processes. The resource is assumed to be a continuous quantity that can be split arbitrarily and allotted to different processes, depending on task demands.” | senses[0] |
| sense | attention - as selection: a mechanism for selecting and prioritizing representations, under which WM is attention to memory representations and the relation is conceptual, not empirical — “A different perspective on the relation between WM and attention emerges when attention is defined not as a resource but as a mechanism for selecting and prioritizing representations. In this perspective, attention does not explain the capacity limit of WM. Rather, we should consider WM as an instance of attention – specifically, WM is attention to memory representations. Holding a set of representations in WM means selecting them from among all the representations that our mind is capable of, thereby rendering them available as input for cognitive operations. As such, WM meets the definition of attention as a mechanism of selection ( Oberauer, 2009 ). In this perspective, the relationship between the concept of WM and the concept of attention is not an empirical but a conceptual one.” | senses[1] |
| relation | WM —is-a→ attention — WM is by definition a form of attention — “By virtue of holding a selected subset of all available representations in memory, WM is by definition a form of attention.” | concept_edges[0] |
| weight | WM —is-a→ attention — 0.85 — “By virtue of holding a selected subset of all available representations in memory, WM is by definition a form of attention.” | concept_edges[0] |
| relation | controlled attention —contrasted-with→ automatic attention — often linked specifically to controlled attention, whereas automatic attention is thought not to be resource demanding — “The concept of attention as a limited resource is often linked specifically to controlled attention, whereas automatic attention is thought not to be resource demanding” | concept_edges[1] |
| weight | controlled attention —contrasted-with→ automatic attention — 0.75 — “The concept of attention as a limited resource is often linked specifically to controlled attention, whereas automatic attention is thought not to be resource demanding” | concept_edges[1] |
| effect direction | verbal WM load —causes→ flanker effect — increases — “Interpretation of this result is complicated by the observation that only a verbal WM load increases the flanker effect – a visual WM load has the opposite effect ( Konstantinou, Beal, King, & Lavie, 2014 ; Konstantinou & Lavie, 2013 ).” — “only a verbal WM load increases the flanker effect” | concept_edges[2] |
| relation | verbal WM load —causes→ flanker effect — only a verbal WM load increases the flanker effect — “Interpretation of this result is complicated by the observation that only a verbal WM load increases the flanker effect – a visual WM load has the opposite effect ( Konstantinou, Beal, King, & Lavie, 2014 ; Konstantinou & Lavie, 2013 ).” | concept_edges[2] |
| weight | verbal WM load —causes→ flanker effect — 0.65 — “Interpretation of this result is complicated by the observation that only a verbal WM load increases the flanker effect – a visual WM load has the opposite effect ( Konstantinou, Beal, King, & Lavie, 2014 ; Konstantinou & Lavie, 2013 ).” | concept_edges[2] |
| replication | not-applicable | |
| no type for this | focus of attention → region of direct access — the focus of attention selects a single item from the subset that forms the region of direct access, itself selected from the activated part of long-term memory — “Therefore, we can distinguish three levels of selection in WM: (1) Selecting information to be in WM, constituting the current memory set, (2) selecting a subset of the memory set, and (3) selecting a single item from that subset. I have referred to these three levels as (1) the activated part of long-term memory, (2) the region of direct access, and (3) the focus of attention, respectively” | unhoused_relations[0] |
| no type for this | controlled attention → executive attention — controlled attention and attention to (cognitive) action are the two aspects of the ambiguous term executive attention — “Nevertheless, I find the term executive attention disquietingly ambiguous, and therefore will use instead the terms attention to (cognitive) action and controlled attention to refer to the two aspects of executive attention, respectively.” | unhoused_relations[1] |
| limitation | The fusion of storage and control resource ideas makes the theory untestable. — “With such a conception, it becomes virtually impossible to say whether some cognitive process – such as filtering or deleting information from WM – renders a net cost or a net gain in resource. As a consequence, the theory becomes untestable.” | limitations[0] |
| limitation | Much about how perceptual attention affects WM cannot be said with confidence. — “To conclude, surprisingly little can be said with confidence: Perceptual attention to stimuli often – but not always – leads to them being encoded into WM to some extent, so that they interfere with similar information. The use of perceptual attention for rehearsal has not been demonstrated convincingly. Whether the focus of attention can stay on an item in WM while perceptual attention engages with a different stimulus in the environment is still unclear.” | limitations[1] |
finding · quantity · variable · definition · key-term — grounded in the full text| finding | Of three resource versions, only the shared resource for storage and processing is empirically well supported. — “Three versions of this idea have been proposed: Attention as a resource for storage and processing, a shared resource for perceptual attention and memory maintenance, and a resource for the control of attention. The first of these three is empirically well supported, but the other two are not.” | content_tags.findings[0] |
| finding | There is no convincing evidence that loading WM depletes a resource needed for the control of attention. — “Taken together, there is no convincing evidence that loading WM depletes a resource needed for the control of attention.” | content_tags.findings[1] |
| finding | Perceptual attention is probably necessary but not sufficient for encoding stimuli into WM. — “As discussed above in the section on Filtering, perceptual attention is probably necessary but not sufficient for encoding of stimuli into WM.” | content_tags.findings[2] |
| quantity | about 3 items — — “In both cases, the CDA amplitude increased with set size up to about 3 items and then levelled off.” | content_tags.quantities[0] |
| quantity | 120 — — “We had participants learn 120 associations between everyday objects and randomly selected colors.” | content_tags.quantities[1] |
| quantity | about 300 ms — — “because the temporal resolution of decoding from BOLD signals is lower than the speed at which the focus of attention shifts from one item to another (i.e., about 300 ms; Oberauer, 2003 ).” | content_tags.quantities[2] |
| definition | working memory — “Beyond these differences in theoretical assumptions, however, there is a broad consensus on what the term working memory refers to: The mechanisms and processes that hold the mental representations currently most needed for an ongoing cognitive task available for processing.” | content_tags.definitions[0] |
| definition | cognitive load — “The extent to which maintenance in WM is impaired by concurrent processing is a monotonic function of cognitive load , defined as the proportion of time during which central attention is engaged by the processing demand ( Barrouillet et al., 2007 ).” | content_tags.definitions[1] |
| key-terms | working memory, attention, focus of attention, controlled attention, cognitive load, task set, filtering, resource |
| concept | working memory — The mechanisms and processes that hold the mental representations currently most needed for an ongoing cognitive task available for processing — “Beyond these differences in theoretical assumptions, however, there is a broad consensus on what the term working memory refers to: The mechanisms and processes that hold the mental representations currently most needed for an ongoing cognitive task available for processing.” | concepts[0] |
| concept | WM — working memory — “The meaning of the concept working memory (WM) depends on the theory in which the concept figures.” | concepts[1] |
| concept | attention — One definition of attention characterizes it as a limited resource for information processing (e.g., Wickens, 1980 ). Another concept of attention is as a process of (or mechanism for) selection of information to be processed with priority (e.g., Chun et al., 2011 ; Desimone & Duncan, 1995 ) — “A first distinction pertains to how attention is defined. One definition of attention characterizes it as a limited resource for information processing (e.g., Wickens, 1980 ). Another concept of attention is as a process of (or mechanism for) selection of information to be processed with priority (e.g., Chun et al., 2011 ; Desimone & Duncan, 1995 ).” | concepts[2] |
| concept | controlled attention — Attention is controlled when it is directed according to our current goals — “The concept of attention as a limited resource is often linked specifically to controlled attention, whereas automatic attention is thought not to be resource demanding” | concepts[3] |
| concept | automatic attention — not defined in this paper's own words; attention whose “direction is influenced by forces independent of our current goals”; thought not to be resource demanding — “The concept of attention as a limited resource is often linked specifically to controlled attention, whereas automatic attention is thought not to be resource demanding” | concepts[4] |
| concept | executive attention — not defined in this paper's own words; “a term that is notoriously poorly defined”, used both for attention to one's own goals and actions and for the top-down control of attention — “Executive attention is a term that is notoriously poorly defined ( Jurado & Rosselli, 2007 ).” | concepts[5] |
| concept | cognitive load — the proportion of time during which central attention is engaged by the processing demand — “The extent to which maintenance in WM is impaired by concurrent processing is a monotonic function of cognitive load , defined as the proportion of time during which central attention is engaged by the processing demand ( Barrouillet et al., 2007 ).” | concepts[6] |
| concept | focus of attention — not defined in this paper's own words; a selection mechanism by which individual items are selected “from the set currently held in WM” — “Our ability to select individual items from the set currently held in WM points to a selection mechanism that I refer to as the focus of attention in WM ( Oberauer, 2002 ; Oberauer & Hein, 2012 ).” | concepts[7] |
| concept | task set — a representation of the relevant stimulus categories, the response options, and the mapping between them — “Selection of responses to stimuli in accordance with the currently relevant task goal is accomplished by holding a task set – a representation of the relevant stimulus categories, the response options, and the mapping between them – in WM ( Monsell, 2003 ; Oberauer et al., 2013 ).” | concepts[8] |
| concept | region of direct access — not defined in this paper's own words; the second of “three levels of selection in WM”: a subset selected from the memory set — “Therefore, we can distinguish three levels of selection in WM: (1) Selecting information to be in WM, constituting the current memory set, (2) selecting a subset of the memory set, and (3) selecting a single item from that subset. I have referred to these three levels as (1) the activated part of long-term memory, (2) the region of direct access, and (3) the focus of attention, respectively” | concepts[9] |
| concept | verbal WM load — not defined in this paper's own words — “Interpretation of this result is complicated by the observation that only a verbal WM load increases the flanker effect – a visual WM load has the opposite effect ( Konstantinou, Beal, King, & Lavie, 2014 ; Konstantinou & Lavie, 2013 ).” | concepts[10] |
| concept | flanker effect — not defined in this paper's own words — “Interpretation of this result is complicated by the observation that only a verbal WM load increases the flanker effect – a visual WM load has the opposite effect ( Konstantinou, Beal, King, & Lavie, 2014 ; Konstantinou & Lavie, 2013 ).” | concepts[11] |
| concept | search template — functions as a “search template”, guiding perceptual attention to matching stimuli — “A more specific version of the same idea is the assumption that the item held in the focus of attention in WM – usually a single item – functions as a “search template”, guiding perceptual attention to matching stimuli ( Olivers, Peters, Houtkamp, & Roelfsema, 2011 ).” | concepts[12] |
Full text — tagged
The reference list is not part of the text we hold for this paper. Our copy was extracted from the publisher's page and the bibliography did not survive that extraction, so the article below ends before its references. Nothing has been removed by us.
Working Memoryterm·dom and Attentionterm·dom - A Conceptual Analysis and Reviewterm·mth Abstract There is broad agreement that working memoryterm·dom is closely related to attentionterm·dom. This article delineates several theoretical options for conceptualizing this link, and evaluates their viability in light of their theoretical implications and the empirical support they received. A first divide exists between the concept of attentionterm·dom as a limited resourceterm·key, and the concept of attentionterm·dom as selective information processing. Theories conceptualizing attentionterm·dom as a resourceterm·key assume that this resourceterm·key is responsible for the limited capacity of working memoryterm·dom. Three versions of this idea have been proposed: Attentionterm·dom as a resourceterm·key for storage and processing, a shared resourceterm·key for perceptual attentionterm·dom and memory maintenance, and a resourceterm·key for the control of attentionterm·dom. The first of these three is empirically well supported, but the other two are not. By contrast, when attentionterm·dom is understood as a selection mechanism, it is usually not invoked to explain the capacity limit of working memoryterm·dom – rather, researchers ask how different forms of attentionterm·dom interact with working memoryterm·dom, in two areas. The first pertains to attentional selection of the contents of working memoryterm·dom, controlled by mechanisms of filteringterm·key out irrelevant stimuli, and removing no-longer relevant representations from working memoryterm·dom. Within working memoryterm·dom contents, a single item is often selected into the focus of attentionterm·dom for processing. The second area pertains to the role of working memoryterm·dom in cognitive control. Working memoryterm·dom contributes to controlling perceptual attentionterm·dom – by holding templates for targets of perceptual selection – and controlling action – by holding task setsterm·dom to implement our current goals.
There is a broad consensus that working memoryterm·dom and attentionterm·dom are intimately linked ( Awh, Jonides, & Reuter-Lorenz, 1998 ; Baddeley, 1993 ; Chun, 2011 ; Cowan, 1995 ; Gazzaley & Nobre, 2012 ; Kane, Bleckley, Conway, & Engle, 2001 ; Kiyonaga & Egner, 2014 ; OberauerpersName, 2009 ; Olivers, 2008 ). But what is it that we agree upon? Both working memoryterm·dom and attentionterm·dom can be conceptualized in different ways, resulting in a broad array of theoretical options for linking them. The purpose of this reviewterm·mth is to propose a map for organizing these theoretical options, delineate their implications, and to evaluate the evidence for each of them.
The meaning of the concept working memoryterm·dom (WMterm·dom) depends on the theory in which the concept figures. The definitions reviewed by Cowan ( 2017 ) differ primarily in the substantive assumptions they include (e.g., whether or not WMterm·dom consists of multiple storage modules, and to what extent it includes long-term memory). Beyond these differences in theoretical assumptions, however, there is a broad consensus on what the term working memoryterm·dom refers to: The mechanisms and processes that hold the mental representations currently most needed for an ongoing cognitive task available for processing.
The meanings of the term attentionterm·dom are more diverse, as they reflect distinctions not only of definitions but also of different referents of the term: Attentionterm·dom is not a unitary entity ( Chun, Golomb, & Turk-Browne, 2011 ). Conceptualizations of attentionterm·dom can be distinguished along several dimensions that provide a coordinate system for our conceptual map. A first distinction pertains to how attentionterm·dom is defined. One definition of attentionterm·dom characterizes it as a limited resourceterm·key for information processing (e.g., Wickens, 1980 ). Another concept of attentionterm·dom is as a process of (or mechanism for) selection of information to be processed with priority (e.g., Chun et al., 2011 ; Desimone & Duncan, 1995 ). These two concepts of attentionterm·dom play different roles in theorizing about working memoryterm·dom, and I will discuss them in turn below.
A second distinction pertains to what we attend to. I find it useful to distinguish the possible objects of attentionterm·dom along two dimensions (see Table 1 ). 1 First, we can distinguish between attentionterm·dom to our currently perceived environment (e.g., attentionterm·dom to visual objects or auditory streams) from attentionterm·dom to information currently not perceived, such as attentionterm·dom to remembered episodes or concepts that we think about. 2 Second, we can distinguish between attentionterm·dom to things and events in the world around us on the one hand, and attentionterm·dom to our own goals and (mental or overt) actions on the other. The latter form of attentionterm·dom includes selection of our current goal or task setterm·dom and shielding it from distraction ( Kane & Engle, 2003 ; Monsell, 2003 ), selection of one of several possible actions ( Pashler, 1994 ), and monitoring of our actions and their outcomes ( Yeung, Botvinick, & Cohen, 2004 ).
A Taxonomy of Attentionterm·dom.
A third distinction pertains to the forces that determine what we attend to – this is the distinction between controlled and automatic deployment of attentionterm·dom ( Shiffrin & Schneider, 1977 ). Attentionterm·dom is controlled when it is directed according to our current goals. The influence of current goals on attentionterm·dom is often referred to as “top-down”. Attentionterm·dom is automatic to the extent that its direction is influenced by forces independent of our current goals – these include the “bottom-up” attraction of attentionterm·dom by perceived properties of the stimuli (e.g., their “salience”) as well as influences of our learning history on what we attend to, for instance when attentionterm·dom is drawn to information that we have learned to be relevant ( Awh, Belopolsky, & Theeuwes, 2012 ; Theeuwes, 2018 ).
The concept of executive attentionterm·dom is often used when discussing the relation between attentionterm·dom and working memoryterm·dom. Executive attentionterm·dom is a term that is notoriously poorly defined ( Jurado & Rosselli, 2007 ). It is used on the one hand to refer to attentionterm·dom directed to one’s own goals and (mental or overt) actions, including response selection ( Szmalec, Vandierendonck, & Kemps, 2005 ), action planning, protecting the pursuit of our current goal from distractions and temptations, as well as switching from one task to another. On the other hand, executive attentionterm·dom is also used to refer to the top-down control of attentionterm·dom, including attentionterm·dom to things and events in the environment – for keeping our attentionterm·dom on the relevant stimuli or features and avoiding distraction by irrelevant ones, as in the Stroop task and the flanker task. As such, the term executive attentionterm·dom is used to denote one pole on each of two dimensions in my proposed taxonomy, one pertaining to the objects of attentionterm·dom (things and events in the world vs. our own goals and actions), the other pertaining to what determines the orientation of attentionterm·dom (controlled vs. automatic). The first meaning assigns executive attentionterm·dom a function in controlling our thoughts and actions (including what we attend to) whereas the second states that executive attentionterm·dom is itself controlled. One way to perhaps bring together the two meanings is by assuming that we attend to (i.e., select, assign resourcesterm·key to) our own goals and actions – including the action of attending to some object – in order to control them. Nevertheless, I find the term executive attentionterm·dom disquietingly ambiguous, and therefore will use instead the terms attentionterm·dom to (cognitive) action and controlled attentionterm·dom to refer to the two aspects of executive attentionterm·dom, respectively.
I organize the reviewterm·mth by the two definitions of attentionterm·dom – as a resourceterm·key or as a selection mechanism – because they have different implications for how attentionterm·dom and working memoryterm·dom are related. Within each section I will discuss the different objects of attentionterm·dom, and the different modes of control.
Attentionterm·dom as a Resourceterm·key The idea of attentionterm·dom as a resourceterm·key is that the cognitive system has a limited resourceterm·key that can be used for carrying out so-called attention-demanding processes. The resourceterm·key is assumed to be a continuous quantity that can be split arbitrarily and allotted to different processes, depending on task demands. Processing efficiency (i.e., speed, accuracy) is a positive monotonic function of the amount of resourceterm·key assigned to a process ( Navon & Gopher, 1979 ). The assumption that WMterm·dom capacity reflects a limited resourceterm·key has a long tradition ( Anderson, Reder, & Lebiere, 1996 ; Case, 1972 ; Just & Carpenter, 1980 ; Ma, Husain, & Bays, 2014 ). Authors linking WMterm·dom to an attentional resourceterm·key are endorsing the view that the limited capacity of WMterm·dom reflects a limited resourceterm·key, and that this resourceterm·key also serves some (or all) functions commonly ascribed to attentionterm·dom. Three versions of this idea can be distinguished by which functions the attentional resourceterm·key is assumed to be needed for: (1) storage and processing of information (e.g., Just & Carpenter, 1992 ), (2) perceptual attentionterm·dom and memory maintenance (e.g., Ester, Fukuda, May, Vogel, & Awh, 2014 ; Kiyonaga & Egner, 2014 ), or (3) the control of attentionterm·dom (e.g., Allen, Baddeley, & Hitch, 2006 ; Baddeley, 1993 , 1996 ; Lavie, 2005 ).
Attentionterm·dom for Storage and Processing Many theorists discussing the relation between working memoryterm·dom and attentionterm·dom characterize attentionterm·dom as a limited resourceterm·key for maintaining representations in an “active”, available state ( Cowan, 2005 ). Often this resourceterm·key is assumed to be shared between “storage” and “processing” ( Case, Kurland, & Goldberg, 1982 ; Cowan et al., 2005 ; Just & Carpenter, 1992 ). According to this view, the same attentional resourceterm·key is required for keeping representations available and for carrying out certain basic cognitive processes such as selecting a response to a stimulus. A prediction from this theory is that attention-demanding cognitive processes compete with concurrent storage ( Z. Chen & Cowan, 2009 ).
There are two variants of this theoretical idea. One is that a share of the resourceterm·key needs to be continuously assigned to a representation to keep it in WMterm·dom ( Case et al., 1982 ). The other is that attentionterm·dom is required directly only for processing, not storage. In this view attentionterm·dom indirectly contributes to memory maintenance because it is needed for refreshing WMterm·dom representations, which would otherwise decay ( Barrouillet, Bernardin, & Camos, 2004 ). Barrouillet and colleagues further specify the resourceterm·key required for refreshing as the limited resourceterm·key for so-called central processes, such as response selection ( Barrouillet, Bernardin, Portrat, Vergauwe, & Camos, 2007 ). Dual-task studies with variants of the PRP (psychological refractory period) paradigm have established a strong capacity limit on central processes ( Pashler, 1994 ), which has been explained by a limited central-attentional resourceterm·key ( Navon & Miller, 2002 ; Tombu & Jolicoeur, 2003 ).
Theorists linking WMterm·dom to attentionterm·dom as resourceterm·key commonly assume that there is a single, content-general attentional resourceterm·key. It follows that storage and processing compete with each other whether or not they share any contents. This assumption leads to the prediction of dual-task costs when WMterm·dom storage and processing demands from very different contents are combined with each other. There is considerable evidence confirming this prediction ( Chein, Moore, & Conway, 2011 ; Morey & Bieler, 2012 ; Saults & Cowan, 2007 ; Vergauwe, Barrouillet, & Camos, 2010 ), lending support to the notion that WMterm·dom capacity is limited by an attentional resourceterm·key. There is also evidence that storage and processing compete for central processing capacity: The extent to which maintenance in WMterm·dom is impaired by concurrent processing is a monotonic function of cognitive loadterm·mth , defined as the proportion of time during which central attentionterm·dom is engaged by the processing demand ( Barrouillet et al., 2007 ).
One problem for the assumption of a shared resourceterm·key for storage and processing is that, although a memory load reduces the efficiency of concurrent response-selection tasks, that dual-task cost diminishes substantially over the first few seconds of the retention interval ( Jolicoeur & Dell’Acqua, 1998 ; Thalmann, Souza, & OberauerpersName, 2019 ; Vergauwe, Camos, & Barrouillet, 2014 ), and is often not observed at all when there is an unfilled interval of a few seconds between encoding of the memory set and commencement of the processing task ( Hazeltine & Witfall, 2011 ; Klapp, Marshburn, & Lester, 1983 ; OberauerpersName, Demmrich, Mayr, & Kliegl, 2001 ). This observation has already led Klapp and colleagues ( 1983 ) to question the idea of a shared resourceterm·key for storage and processing: To uphold this idea we would have to assume that the resourceterm·key demand of maintenance dwindles to a negligible level within a few seconds. This would be compatible with the assumption that a central processing resourceterm·key is required for short-term consolidation of information in working memoryterm·dom ( Jolicoeur & Dell’Acqua, 1998 ; Nieuwenstein & Wyble, 2014 ; Ricker & Hardman, 2017 ) but not with the assumption that a resourceterm·key is needed for maintenance throughout the retention interval.
As mentioned above, the assumption of shared resourcesterm·key for storage and processing comes in two variants: The first, traditional one is that a representation needs a share of the resourceterm·key assigned to it to be in WMterm·dom, and the same resourceterm·key is needed for carrying out cognitive operations. The second variant is that maintenance processing such as refreshing share a limited resourceterm·key with other cognitive operations ( Barrouillet et al., 2004 ). The second variant rests on the premise that without refreshing the representations in WMterm·dom decay – only on that assumption does the processing resourceterm·key assigned to refreshing become essential for WMterm·dom maintenance. The decay assumption, however, is probably not true, at least for verbal materials ( OberauerpersName & Lewandowsky, 2013 , 2014 ).
The first variant has a conceptual problem: Simultaneous maintenance and processing compete for a shared resourceterm·key only until the processing task is completed – after that, the full resourceterm·key can be re-assigned to the representations in WMterm·dom. Why then should memory performance suffer from a concurrent processing task although memory is tested only after the processing task is done? (for a more detailed treatment see OberauerpersName, Farrell, Jarrold, & Lewandowsky, 2016 ). The problem is illustrated by a study that, according to the authors, reveals the neuronal basis of resourceterm·key sharing: Watanabe and Funahashi ( 2014 ) recorded from multiple neurons in the lateral pre-frontal cortex (LPFC) while monkeys did a spatial attentionterm·dom task, a spatial WMterm·dom task, or a dual-task combination of the two. The two tasks recruited largely overlapping LPFC neurons, which showed spatial selectivity when each task was done alone. While both tasks were done simultaneously, the LPFC neurons lost most of their spatial selectivity, and collectively their firing rate pattern contained less information about the attended location and the remembered location during that period. After the attentionterm·dom task was completed, however, the information about the location in memory was “reawakened” in the firing pattern of the LPFC neurons, reaching the same strength as in the single-task condition. The authors did observe a (small) performance decrement in the dual-task relative to the single-task condition, but that dual-task cost is not explained by their neural data – looking at the neural data, we would expect no detrimental effect on memory by the concurrent attentionterm·dom task.
To conclude, the assumption of a shared resourceterm·key for memory retention and central processes has received much empirical support. At the same time, it is challenged by the finding that dual-task costs on processing speed tend to vanish over time, and – depending on the version endorsed – the lack of evidence for decay, and the problem of how to explain that the competition between processing and storage affects memory performance after the competition has ended.
Attentionterm·dom for Perception and Memory A resourceterm·key shared between “storage” and “processing” spans both sides of the distinction between attentionterm·dom to things and events (i.e., the information to be stored), and attentionterm·dom to goals and actions (i.e., to the task setsterm·dom guiding the processing operations). We can also ask whether the same resourceterm·key applies to both sides of another distinction, the one between perceptual attentionterm·dom and attentionterm·dom to not-perceived objects. Most task paradigms for studying WMterm·dom require retention of information in the absence of perceptual input. There is evidence, however, that the limited capacity of WMterm·dom applies not only to information in memory but equally to information still in view. Tsubomi, Fukuda, Watanabe, and Vogel ( 2013 ) measured the contralateral delay activity (CDA), a neural marker of the number of objects a person holds in visual WMterm·dom ( Luria, Balaban, Awh, & Vogel, 2016 ; Vogel & Machizawa, 2004 ) while participants attended to a variable number of color patches still in view, or attempted to remember them after their offset. In both cases, the CDA amplitude increased with set size up to about 3 items and then levelled off. Individual CDA amplitudes correlated with performance on a test of one randomly selected item regardless of whether that item remained in view until the time of test or had to be retained in memory for a second.
The study of Tsubomi et al. ( 2013 ) shows striking similarities between the capacity limits for attending to perceptual stimuli and for maintaining stimuli in memory (see also Ester et al., 2014 ). Still, these two functions could rely on separate resourcesterm·key that happen to bear similarities to each other. If the same limited resourceterm·key underlies perceptual attentionterm·dom and maintenance in WMterm·dom, then demanding both at the same time should incur a substantial dual-task cost, such that when the load of one task is increased, performance on the other suffers. The evidence for this prediction is mixed. Fougnie and Marois ( 2006 ) found load-dependent dual-task costs when combining a visual WMterm·dom task with a visual attentionterm·dom task (simultaneous tracking of multiple moving objects, or monitoring multiple parallel streams of rapidly presented visual stimuli for a target) but these costs were less than the cost of combining two visual WMterm·dom tasks. Souza and OberauerpersName ( 2017 ) found only negligible dual-task costs when inserting a visual attentionterm·dom task (monitoring a stimulus for a subtle brightness change) in the retention interval of a visual WMterm·dom task. Several studies investigated dual-task costs between WMterm·dom and visual search. These dual-task costs increase with the load on each of the two tasks – as expected on the assumption of a shared resourceterm·key – only when the contents of WMterm·dom were spatial locations (for a reviewterm·mth see Woodman & Chun, 2006 ). To conclude, although attending to perceptual information and maintaining information in WMterm·dom after it disappeared from the environment have much in common, the evidence that they share a limited resourceterm·key is not yet convincing.
Controlled Attentionterm·dom The concept of attentionterm·dom as a limited resourceterm·key is often linked specifically to controlled attentionterm·dom, whereas automatic attentionterm·dom is thought not to be resourceterm·key demanding ( Schneider & Shiffrin, 1977 ; Shiffrin & Schneider, 1977 ). There are two ways in which this link can be spelled out: (a) Attentionterm·dom that is allocated in a controlled manner – according to “top down” influences from our current goals – underlies a resourceterm·key limit but attentionterm·dom that is automatically attracted to some information independent of its relevance for our current goal does not underlie that resourceterm·key limit. Stated in this way we face the awkward conclusion that allocating attentionterm·dom to the same object (e.g., a red traffic light in a street scene, or a word we hold in WMterm·dom) does or does not rely on a limited resourceterm·key depending on what forces led attentionterm·dom to that object. The same cognitive function – prioritizing processing of the attended information – would be resourceterm·key consuming or not depending on how it was invoked.
In my view, a less awkward interpretation is: (b) Paying attentionterm·dom to an object does not require a resourceterm·key per se – rather the process of controlling attentionterm·dom in a top-down manner consumes the limited resourceterm·key. This interpretation reflects how Shiffrin and Schneider ( 1977, p. 156 ) explain why controlled processes are capacity limited: These processes need to be controlled by continuously paying attentionterm·dom to them, and attentionterm·dom cannot be allocated to more than one process at a time. In other words, the attentional resourceterm·key imposes a bottleneck on the control processes, not on the controlled processes. The limitation is on how many different (cognitive or overt) actions we can attend to at the same time in order to control them. For instance, in visual search, perceptual attentionterm·dom can be drawn to some stimuli automatically, and theoretically there is no limit on how many such forces exert their pull in parallel. Perceptual attentionterm·dom can also be directed in a controlled manner – by attending to the action of deploying attentionterm·dom to visual stimuli – and this control process is limited to one action at a time. The limitation does not rest with the controlled attentionterm·dom – a limit on how many visual stimuli can be attended at the same time – but with the controlling attentionterm·dom.
This conception of an attentional resourceterm·key differs from the preceding two. The notion of a resourceterm·key for storage and processing and the idea of a shared attentional resourceterm·key for perception and memory share the assumption that the resourceterm·key is allocated to representations of objects and events that we perceive or hold in WMterm·dom. In contrast, the “attentional control” idea assumes a resourceterm·key for the control of what we attend to, and more generally, of what we think and do. These conceptualizations have different implications when we apply them to WMterm·dom. For instance, consider a situation in which WMterm·dom receives an overload of information, some of which is relevant and some of which is irrelevant. Examples of this scenario are the complex-span paradigm ( Daneman & Carpenter, 1980 ), in which to-be-remembered items alternate with stimuli to be processed but not retained, or the filteringterm·key paradigm ( Vogel, McCollough, & Machizawa, 2005 ), in which participants see an array of visual stimuli and need to remember a pre-defined subset (e.g., only the red objects). According to theories assuming a limited resourceterm·key allocated to representations in WMterm·dom, attentionterm·dom limits how much of the given information can be retained, and a separate parameter determines the filteringterm·key efficiency, that is, the extent to which the cognitive system manages to keep the distractor information out of WMterm·dom, so that it does not consume part of the valuable storage resourceterm·key. These theories predict that individuals with lower WMterm·dom capacity maintain a smaller amount of both relevant and irrelevant information, but their proportion, reflecting filteringterm·key efficiency, should be independent of WMterm·dom capacity. According to the controlled-attention view, by contrast, the attentional resourceterm·key determines the filteringterm·key efficiency. Hence, individuals with lower WMterm·dom capacity retain the same amount of information as those with higher capacity, but people differing in WMterm·dom capacity differ in the ratio of relevant to irrelevant information that they retain.
Paradoxes lurk when we try to combine the two notions of attentional resourcesterm·key, assuming that the same limited resourceterm·key is required for both storage and control: According to this fusion version of the attentional-resource idea, keeping some irrelevant piece of information out of WMterm·dom, or removing it from WMterm·dom, consumes attentional resourceterm·key (because it is an act of control over what we attend to) and at the same time frees up attentional resourceterm·key (because it reduces the amount of information that is held in WMterm·dom). In the same manner, stopping a cognitive process costs attentional resourceterm·key but at the same time frees up attentional resourceterm·key. With such a conception, it becomes virtually impossible to say whether some cognitive process – such as filteringterm·key or deleting information from WMterm·dom – renders a net cost or a net gain in resourceterm·key. As a consequence, the theory becomes untestable. This problem needs to be kept in mind when attempts are made to reconcile the two versions of attentional-resource theories of WMterm·dom (e.g., Cowan, Fristoe, Elliott, Brunner, & Saults, 2006 ). 3 If WMterm·dom and the control of attentionterm·dom share a limited resourceterm·key, we should expect substantial dual-task costs when an attention-control demand is combined with WMterm·dom maintenance. Evidence for such a dual-task cost comes from studies demonstrating that a load on WMterm·dom increases people’s susceptibility to distraction, for instance by the irrelevant stimuli in a flanker task ( Kelley & Lavie, 2011 ; Lavie, Hirst, de Fockert, & Viding, 2004 ). Interpretation of this result is complicated by the observation that only a verbal WM loadterm·dom increases the flanker effectterm·dom – a visual WMterm·dom load has the opposite effect ( Konstantinou, Beal, King, & Lavie, 2014 ; Konstantinou & Lavie, 2013 ). Konstantinou et al. ( 2014 ) explain this dissociation by assuming that visual WMterm·dom contents place a load on a visual perceptual resourceterm·key, and increasing the load on perceptual resourcesterm·key has been shown to reduce flanker interference ( Lavie, 2005 ). In contrast, verbal WMterm·dom relies on rehearsal for maintenance, and rehearsal competes for a shared attentional-control resourceterm·key with the control of visual attentionterm·dom. The latter assumption is at odds with the position of most other resourceterm·key theorists, who assume that rehearsal requires little, if any such resourceterm·key ( Baddeley, 1986 ; Camos, Lagner, & Barrouillet, 2009 ; Cowan, 2001 ). Other studies provide further evidence that a load on WMterm·dom can both increase and decrease people’s distractability by a flanker stimulus during a perceptual comparison task: When the category of stimuli held in WMterm·dom matched that of the targets of the comparison task (but not that of the flankers), the flanker compatibility effect increased, but when the WMterm·dom contents matched the category of the flankers, and not the targets, then the flanker compatibility effect decreased under load compared to no load ( Kim, Kim, & Chun, 2005 ; Park, Kim, & Chun, 2007 ). Taken together, there is no convincing evidence that loading WMterm·dom depletes a resourceterm·key needed for the control of attentionterm·dom.
We can also ask whether concurrent demands on the control of attentionterm·dom impair performance in a WMterm·dom task. This appears not to be the case. The effect of concurrent processing on memory is larger when the processing task requires more attentionterm·dom control (e.g., task switching vs. task repetition, incongruent vs. neutral Stroop trials), but that effect is entirely accounted for by the longer duration of response selection in the more difficult conditions ( Barrouillet, Portrat, & Camos, 2011 ; Liefooghe, Barrouillet, Vandierendonck, & Camos, 2008 ). Hence, the dual-task cost of concurrent processing for memory is a function of the demand on central attentionterm·dom for action selection, not the demand on the control of attentionterm·dom. Moreover, Lawrence, Myerson, Oonk, and Abrams ( 2001 ) found that when people had to make saccades to irrelevant locations during the retention interval, memory performance is impaired, in particular for spatial information. That effect was equally large for reflexive saccades towards a suddenly appearing target and for controlled anti-saccades away from a target, contrary to the assumption that the control of attentionterm·dom in the anti-saccade condition competes for WMterm·dom resourcesterm·key. Bunting, Cowan, and Colflesh ( 2008 ) used a manual analog of the anti-saccade task as distractor activity during the retention interval, and found significantly worse performance in the anti-press than the pro-press condition in only 3 out of 12 experimental conditions.
A second prediction from the assumption that WMterm·dom maintenance and controlled attentionterm·dom share a resourceterm·key is that measures of the efficiency of the two should be correlated across individuals. This prediction has been tested with regard to two forms of control over the contents of WMterm·dom ( Hasher, Zacks, & May, 1999 ): Filteringterm·key irrelevant stimuli at encoding so that they never enter WMterm·dom, and removal of no-longer relevant stimuli from WMterm·dom after they have been encoded. Support for the prediction comes from studies measuring filteringterm·key efficiency in visual change-detection tasks through the effect of irrelevant stimuli on the CDA ( Vogel et al., 2005 ). Individual differences in filteringterm·key efficiency are strongly correlated with accuracy in change detection ( Luria et al., 2016 ). However, when Mall, Morey, Wolff, and Lehnert ( 2014 ) measured filteringterm·key efficiency through behavioral indicators – the performance gain from being able to ignore half the stimuli in the array, and the proportion of time people fixated on locations of irrelevant stimuli during encoding and retention – they found no correlation with people’s WMterm·dom capacity, measured through complex-span tasks. One possible interpretation is that controlled attentionterm·dom (as indexed by filteringterm·key) and WMterm·dom maintenance share a resourceterm·key that is not domain general but rather specific to visual stimuli. Removal efficiency has been measured through the speed with which people remove to-be-updated information from WMterm·dom in an updating paradigm ( Ecker, Lewandowsky, & OberauerpersName, 2014 ). Whereas this first study showed no correlation of removal efficiency with WMterm·dom capacity, a subsequent study measuring removal efficiency through a larger set of updating tasks observed a small positive correlation ( Singh, Gignac, Brydges, & Ecker, 2018 ). This result could reflect a shared resourceterm·key for WMterm·dom maintenance and attentional control. Alternatively, it could mean that people who efficiently remove no-longer relevant information from WMterm·dom are better at reducing interference from that information in WMterm·dom, which improves their ability to retrieve the relevant information ( OberauerpersName, Lewandowsky, Farrell, Jarrold, & Greaves, 2012 ).
Other research investigated the correlation between WMterm·dom capacity and measures of attentional control outside the context of WMterm·dom tasks, for instance the ability to attend to relevant and ignore irrelevant stimuli or features in perceptual decision tasks (e.g., the Stroop, flanker, or Simon task), the ability to suppress a strong action tendency (e.g., moving the eyes away from a suddenly appearing stimulus in the anti-saccade task), or the ability to stop an already prepared action (i.e., the stop-signal paradigm). Numerous studies have found positive correlations between WMterm·dom capacity and these measures of attentionterm·dom control (e.g., Chuderski, 2014 ; McVay & Kane, 2012 ; Shipstead, Lindsey, Marshall, & Engle, 2014 ; Unsworth, 2015 ; Unsworth, Fukuda, Awh, & Vogel, 2014 ), whereas a few others failed to find such a relationship ( Keye, Wilhelm, OberauerpersName, & van Ravenzwaaij, 2009 ; Wilhelm, Hildebrandt, & OberauerpersName, 2013 ). Additional support comes from findings of a positive correlation between WMterm·dom capacity and people’s self-reported mind wandering in response to thought probes during a cognitive task ( McVay & Kane, 2009 , 2012 ; Randall, Oswald, & Beier, 2014 ).
Taken together, the evidence for a close relation between WMterm·dom and the control of attentionterm·dom is mixed. The most convincing evidence comes from correlational studies linking WMterm·dom capacity to indicators of attentionterm·dom control from tasks without a memory demand. There is some evidence that WMterm·dom capacity is also correlated with the efficiency of controlling the contents of WMterm·dom through filteringterm·key and removal, but it is yet too weak and inconsistent to draw strong conclusions. This correlational evidence, however, can be explained without invoking the notion of a shared resourceterm·key, as I’ll discuss below (in the section “How is WMterm·dom related to the control of attentionterm·dom and action?”). The experimental evidence from dual-task costs speaks against competition between WMterm·dom maintenance and attentionterm·dom control for a shared resourceterm·key.
I have considered three theoretical options for spelling out the idea of WMterm·dom as relying on an attentional resourceterm·key: (1) a shared resourceterm·key for “storage” and “processing”, (2) a shared resourceterm·key for perceptual attentionterm·dom and WMterm·dom, and (3) a shared resourceterm·key for attentionterm·dom control and WMterm·dom. Of these three, the first option has received the most convincing empirical support, but it also suffers from empirical challenges, and from the conceptual problem of explaining how the competition for resourcesterm·key between storage and processing can have an impact on memory performance after the competition is over. I do not see these challenges as fatal – it is probably still too early to announce the “demise” ( Klapp et al., 1983 ) of the idea that WMterm·dom is limited by an attentional resourceterm·key – but theorists working with this concept should aim to address these challenges. In the remainder of this article I discuss the relation of WMterm·dom to attentionterm·dom from the perspective that attentionterm·dom is the selection and prioritization of information, which does not entail a commitment to a limited resourceterm·key.
Attentionterm·dom as Selection A different perspective on the relation between WMterm·dom and attentionterm·dom emerges when attentionterm·dom is defined not as a resourceterm·key but as a mechanism for selecting and prioritizing representations. In this perspective, attentionterm·dom does not explain the capacity limit of WMterm·dom. Rather, we should consider WMterm·dom as an instance of attentionterm·dom – specifically, WMterm·dom is attentionterm·dom to memory representations. Holding a set of representations in WMterm·dom means selecting them from among all the representations that our mind is capable of, thereby rendering them available as input for cognitive operations. As such, WMterm·dom meets the definition of attentionterm·dom as a mechanism of selection ( OberauerpersName, 2009 ). In this perspective, the relationship between the concept of WMterm·dom and the concept of attentionterm·dom is not an empirical but a conceptual one.
Nevertheless, we can ask several empirical questions about how WMterm·dom is related to attentionterm·dom as a selection mechanism: (1) How is information selected into WMterm·dom? (2) How is information selected within WMterm·dom? (3) What is the relation between attentionterm·dom to memory and attentionterm·dom to perceived stimuli – are they the same, and if not, how do they influence each other? (4) How is WMterm·dom related to the control of attentionterm·dom and action? I next address these questions in turn.
How is Information Selected into Working Memoryterm·dom?
Information can be selected to be brought into WMterm·dom from perception or from long-term memory. This selection is to a large extent controlled: People are very good, though not perfect, at letting only relevant information into WMterm·dom. Moreover, people also have control over which information to keep in WMterm·dom and which to remove.
Filteringterm·key Perceptual Information. With regard to perceived information, perceptual attentionterm·dom arguably plays an important role in selecting which stimuli are encoded into WMterm·dom. Stimuli that are known to be irrelevant from the start, and are easy to discriminate from relevant stimuli, can be filtered out very effectively ( Baddeley, Papagno, & Andrade, 1993 ), though not always perfectly ( Ueno, Allen, Baddeley, Hitch, & Saito, 2011 ; Vogel et al., 2005 ); children and older adults seem to have more difficulty with filteringterm·key irrelevant stimuli at encoding ( Sander, Werkle-Bergner, & Lindenberger, 2011 ). A question discussed in the context of visual WMterm·dom is whether people can selectively encode relevant features but not irrelevant features of the same visual object. Some experiments show that relevant and irrelevant features of the same object have similar behavioral effects on memory performance ( Marshall & Bays, 2013 ) and attentional capture ( Gao et al., 2016 ; see the section on effects of WMterm·dom on perceptual attentionterm·dom for an explanation of this effect). However, one fMRI study found that the relevant but not the irrelevant feature of a visual object could be reconstructed from the pattern of BOLD activity during the retention interval ( Yu & Shim, 2017 ). Logie, Brockmole, and Jaswal ( 2011 ) have tested the effects of changes in irrelevant features on change-detection accuracy and found that such changes impair performance for retention intervals up to about 2 s but not thereafter. They propose that irrelevant features are initially encoded and subsequently removed from WMterm·dom. This could explain why irrelevant features are not detectable in the sluggish BOLD signal that aggregates information over several seconds.
Filteringterm·key could be accomplished by perceptual selection – not attending to the irrelevant stimuli – but it could also be a separate selection step, such that a stimulus, even though selected for perceptual attentionterm·dom, is not encoded into WMterm·dom. The latter possibility would imply that perceptual attentionterm·dom might be necessary, but is not sufficient for encoding them into WMterm·dom. Evidence for this possibility comes from several sources. A series of experiments by H. Chen and Wyble ( 2015a , 2015b ) used stimuli as attentional cues for a perceptual decision task, and after several trials inserted a surprise memory test for a feature of the cue. Although they have arguably attended to the cue because it was relevant for the decision task, people had poor memory for its features only a few seconds after its disappearance, suggesting that the stimulus, or at least the feature probed in the memory test, was not encoded into WMterm·dom. When people expected the memory test, their performance was much better. In a related experiment H. Chen, Swan, and Wyble ( 2016 ) had participants visually track several moving target objects among distractors. To avoid confusing the targets with distractors participants had to continuously attend to them while they moved. Yet, in a surprise memory test they had little memory for the target’s colors.
A second source of evidence suggesting that attentionterm·dom is not sufficient to encode stimuli into WMterm·dom comes from some of my experiments ( OberauerpersName, 2018 ): Participants saw six words presented one by one in different screen locations; each word was followed by a cue to remember or forget it. The cue appeared only after word offset so that people had to attend to each word in case they would have to remember it. I also varied the time interval between each forget cue and the onset of the next word to manipulate how much time people had to remove a to-be-forgotten word from WMterm·dom. The to-be-forgotten words had no effect on memory performance regardless of the cue-word interval, implying that they did not contribute at all to the load on WMterm·dom.
These findings could mean that information, although attended, is not encoded into WMterm·dom. Alternatively, the visual stimuli of Chen and Wyble, or the to-be-forgotten words in my experiments, could be encoded into WMterm·dom but then removed very quickly so that their accessibility, and their effect on WMterm·dom load, was not measurable even a few seconds later (see the section below on Removal). Perhaps neurophysiological markers of WMterm·dom load with high temporal resolution, such as the CDA, could be leveraged to distinguish between these possibilities.
One limitation for efficient filteringterm·key (or removal) arises when people have to process the distracting material. When participants in my experiments ( OberauerpersName, 2018 ) had to make a judgment on each word while it was on the screen, they could not entirely prevent encoding to-be-forgotten words into WMterm·dom, though they were still able to diminish their effect on WMterm·dom load relative to to-be-remembered words. Marshall and Bays ( 2013 ) found that comparing two stimuli during the retention interval of a visual WMterm·dom task impaired WMterm·dom performance as much as adding two more stimuli to the memory set, suggesting that encoding of these stimuli into WMterm·dom could not be prevented at all.
Selective Retrieval from Long-Term Memory. Much of the information we process in WMterm·dom comes from long-term memory. For the WMterm·dom system to work effectively, it has to retrieve information from long-term memory selectively, so that only information useful for the current task enters WMterm·dom ( OberauerpersName, 2009 ). A demonstration of the effectiveness of this gating mechanism comes from experiments investigating the effect of previously acquired long-term memories on WMterm·dom performance ( OberauerpersName, Awh, & Sutterer, 2017 ). We had participants learn 120 associations between everyday objects and randomly selected colors. In a subsequent WMterm·dom test they had to maintain three object-color conjunctions on each trial, and reproduce each object’s color by selecting it on a color wheel. Some of the objects in the WMterm·dom test were objects for which they had learned an associated color before. These objects could reoccur in the WMterm·dom test with their learned color – in which case retrieving the associated color should facilitate WMterm·dom performance – whereas others reoccurred with a new random color – in which case retrieving the color from long-term memory should interfere with WMterm·dom performance. We found evidence for proactive facilitation, but against proactive interference, implying that information from long-term memory is used if and only if the information in WMterm·dom was so poor that drawing on long-term memory could only make things better.
Removal of Information from WMterm·dom. The selection of which information to hold in WMterm·dom is also controlled after encoding: Information no longer relevant must be rapidly removed so that it does not clutter WMterm·dom ( Hasher et al., 1999 ). There is a body of evidence showing that people can selectively remove no-longer relevant information from WMterm·dom (for a reviewterm·mth see Lewis-Peacock, Kessler, & OberauerpersName, 2018 ).
Removing an entire memory set when replacing it with a new one is a seamless and rapid process, though – as filteringterm·key – it is not perfect: Traces of the old memory set remain in WMterm·dom, creating some mild proactive interference when items in the two sets are similar to each other ( Ralph et al., 2011 ; Tehan & Humphreys, 1998 ), and a congruency benefit when the two sets partially overlap, sharing the same items in the same contexts ( OberauerpersName, Souza, Druey, & Gade, 2013 ). Removal of a single item from the current memory set has been isolated experimentally as a process involved in WMterm·dom updating ( Ecker, OberauerpersName, & Lewandowsky, 2014 ). By contrast, removal is much less efficient when it comes to removing more than one item from a memory set but less than all of them: People find it difficult to remove a random subset of several items from a memory set. For instance, when informed, after encoding a list of six words, that the words in positions 2, 3, and 5 could be forgotten, there was no evidence that they did so – successful removal of a subset of three words was found only when they were already clearly marked as a separate subset at encoding ( OberauerpersName, 2018 ). In sum, the efficiency of removal is limited by the ability to discriminate between to-be-maintained and to-be-removed contents of WMterm·dom.
To conclude, the WMterm·dom system is equipped with very efficient – though not perfect – mechanisms for controlling its contents through filteringterm·key perceptual input, selectively retrieving information from LTM, and removing no-longer relevant materials. Through these selection processes the cognitive system manages to usually have only the most relevant information for the current goal in WMterm·dom.
How is Information selected within WMterm·dom?
Selecting information to be held in WMterm·dom is a form of selection, but it not necessarily selection of one piece of information at the exclusion of all others: We often hold multiple separate items in WMterm·dom simultaneously. Sometimes we have to select a single item from the set currently held in WMterm·dom as the input for a process, or as the object of mental manipulation. Our ability to select individual items from the set currently held in WMterm·dom points to a selection mechanism that I refer to as the focus of attentionterm·dom in WMterm·dom ( OberauerpersName, 2002 ; OberauerpersName & Hein, 2012 ). Evidence for the operation of such a narrow selection mechanism within WMterm·dom comes from three observations: (1) In short-term recognition tests the last-presented item in a list is accessed at a faster rate than preceding items, and this has been interpreted as showing that the last-encoded item remains in the focus of attentionterm·dom (for a reviewterm·mth McElree, 2006 ). (2) When an item in WMterm·dom is needed as input for a cognitive operation (e.g., adding or subtracting a number from a particular digit in WMterm·dom), or when one item needs to be selected as the object of an updating operation (e.g., replacing an item in WMterm·dom by a new stimulus), then operating on the same WMterm·dom item again in the next step takes less time than selecting another item from the memory set for the next operation. This item-switch cost (or item-repetition benefit) has been explained by assuming that the object of a cognitive operation remains in the focus of attentionterm·dom after the operation has been completed, and therefore does not need to be selected again when the same object is required for the next operation ( Garavan, 1998 ; OberauerpersName, 2003 ). (3) After encoding a set of stimuli into WMterm·dom, a retro-cue presented one to several seconds into the retention interval can guide attentionterm·dom to one item and thereby improve memory performance when that item is tested – often at the expense of performance when another item is tested ( Griffin & Nobre, 2003 ; Landman, Spekreijse, & Lamme, 2003 ; for a reviewterm·mth see Souza & OberauerpersName, 2016 ).
Whereas most of these empirical demonstrations come from situations in which a single item in WMterm·dom needs to be selected, it has been argued that the focus of attentionterm·dom can hold more than one item ( Gilchrist & Cowan, 2011 ). From the perspective of attentionterm·dom as selection, this should be feasible to the extent that selecting multiple items simultaneously does not undercut the purpose of selection. For instance, if the task is to update one out of several digits in WMterm·dom through an arithmetic operation, selecting more than that one digit into the focus of attentionterm·dom would only lead to confusion – but if the task is to add two digits in WMterm·dom together, selecting both of them into the focus of attentionterm·dom at the same time is arguably useful because then they could be used simultaneously as retrieval cues for the relevant arithmetic fact ( OberauerpersName, 2013 ). Another situation in which it is functional to select two items into the focus simultaneously is when two tasks must be carried out simultaneously, one on each item, and the two items are sufficiently different to not risk cross-talk between the two tasks ( Göthe, OberauerpersName, & Kliegl, 2016 ; OberauerpersName & Bialkova, 2011 ).
Using the retro-cue paradigm, neuroscience research has revealed a distinction between attended and unattended information in WMterm·dom 4 : Whereas the attended information can be decoded from neural signals such as the pattern of BOLD activity over voxels, or the pattern of EEG activity over electrodes, the unattended information cannot – it remains neurally silent, but can be brought back into a neurally active state later by a retro-cue drawing attentionterm·dom to it ( LaRocque, Lewis-Peacock, Drysdale, OberauerpersName, & Postle, 2013 ; Lewis-Peacock, Drysdale, OberauerpersName, & Postle, 2011 ; Sprague, Ester, & Serences, 2016 ) or by an uninformative strong input to the cortex ( Rose et al., 2016 ; Wolff, Jochim, Akyürek, & Stokes, 2017 ). One recent study, however, paints a more differentiated picture: Decoding of orientations maintained in VWM from fMRI signals in visual cortex was again good for attended and absent for unattended items, but decoding from signals in parietal cortex (IPS and frontal eye fields) was equally good for both attended and unattended items – though much weaker than decoding of attended items in visual cortex ( Christophel, Iamshchinina, Yan, Allefeld, & Haynes, 2018 ).
Behavioral evidence shows that retro-cues can be used to select not just individual items but also subsets of several items within WMterm·dom ( OberauerpersName, 2001 , 2005 ), and selection of a subset can be followed by selection of an item within that subset ( OberauerpersName, 2002 ). Therefore, we can distinguish three levels of selection in WMterm·dom: (1) Selecting information to be in WMterm·dom, constituting the current memory set, (2) selecting a subset of the memory set, and (3) selecting a single item from that subset. I have referred to these three levels as (1) the activated part of long-term memory, (2) the region of direct accessterm·dom, and (3) the focus of attentionterm·dom, respectively (see OberauerpersName, 2009 , for a detailed discussion of the 3-level framework and evidence supporting it; and OberauerpersName et al., 2013 , for a computational implementation). It is currently not clear whether more than one WMterm·dom representation is neurally active (i.e., decodable from neural activity during the retention interval) at the same time, so we do not know whether the state of being neurally active characterizes the second or the third level of selection. One possibility is that during WMterm·dom maintenance multiple representations – those in the direct-access region – are active at the same time, such that their pattern of neural activity is superimposed. Another possibility is that only one item – the one in the focus of attentionterm·dom – is neurally active at any time. If the focus of attentionterm·dom circulates among the items in WMterm·dom, it would still be possible to decode several items from neural activation patterns ( Emrich, Rigall, LaRocque, & Postle, 2013 ) because the temporal resolution of decoding from BOLD signals is lower than the speed at which the focus of attentionterm·dom shifts from one item to another (i.e., about 300 ms; OberauerpersName, 2003 ).
Univariate neural correlates of WMterm·dom load, most notably the amplitude of the CDA ( Vogel & Machizawa, 2004 ) and the BOLD activation in the inter-parietal sulcus (IPS) ( Todd & Marois, 2004 , 2005 ; Xu & Chun, 2006 ), imply that at least some form of persistent neural activity increases with the number of items maintained in WMterm·dom. These neural measures, however, do not carry information about the content of WMterm·dom, and therefore we do not know whether they reflect neurally active representations or some neural activity reflecting control processes that are involved in maintaining items selected. Another open question is whether these univariate measures of WMterm·dom load reflect the first or the second level of selection – to find out we need studies that track these neural indicators of WMterm·dom load while a retro-cue asks participants to select a subset of the current memory set: Does the neural marker track the set size of the subset or of the entire memory set? One study asking this question found that BOLD activation in IPS reflects the size of the entire memory set before the retro-cue but the size of the cued subset afterwards ( Lepsien, Thornton, & Nobre, 2011 ), suggesting that IPS activation reflects the second level of selection, the direct-access region. In that study, however, participants were not asked to still maintain the not-cued subset in memory, so we don’t know whether they maintained it (at the third selection level, the activated part of LTM) or just removed it from WMterm·dom.
A somewhat speculative hypothesis on how to reconcile all these findings is that univariate markers of WMterm·dom load track the amount of information selected at the second level (i.e., the direct-access region). This information is maintained in WMterm·dom through temporary bindings between contents and contexts through which they are accessible, probably in parietal cortex. These bindings are neurally silent – either because they are implemented through rapid synaptic plasticity ( Mongillo, Barak, & Tsodyks, 2008 ) or because they are implemented in a pattern of neural activity that bears no similarity to the bound contents, such as a circular convolution of each content with its context ( Eliasmith, 2013 ; Plate, 2003 ), so that they cannot be identified through decoding of the WMterm·dom contents. However, neural activity patterns corresponding to the contents of the direct-access region could be re-activated during the retention interval by feeding non-specific activation into the contexts that act as retrieval cues for these contents, so that they could (faintly) be decoded from parietal cortical areas ( Bettencourt & Xu, 2016 ; Christophel et al., 2018 ). This non-specific activation could be spontaneous noise in the neural network ( OberauerpersName & Lin, 2017 ), or an attentional mechanism that selectively activates all contexts to which the contents of the direct-access region are bound. The content (or contents) selected for the third level of selection, the focus of attentionterm·dom, is represented in a neurally active fashion, probably in the prefrontal cortex ( Bichot, Heard, DeGennaro, & Desimone, 2015 ; Mendoza-Halliday & Martinez-Trujillo, 2017 ), and this representation re-activates the corresponding sensory representation in those sensory cortical areas involved in its initial processing, so that the information in the focus of attentionterm·dom can be decoded from neural activity in those areas.
A prediction from this hypothesis is that when two to-be-remembered stimuli are presented sequentially, univariate markers such as the CDA should add up to reflect the combined load of both stimuli, whereas the decodability of the first stimulus should be substantially impaired by the encoding of the second, because the focus of attentionterm·dom abandons the first to encode the second stimulus. Evidence for the first assumption comes from studies showing that the CDA reflects the combined load of two successively presented parts of a memory set ( Feldmann-Wüstefeld, Vogel, & Awh, 2018 ; Ikkai, McCollough, & Vogel, 2010 ); the second prediction remains to be tested.
What is the Relation between WMterm·dom and Perceptual Attentionterm·dom?
An extreme position would be that WMterm·dom and perceptual attentionterm·dom are the same: By virtue of attending to a perceived stimulus, it is selected into WMterm·dom. Maintaining stimuli in WMterm·dom that are no longer present in the environment differs from perceptual attentionterm·dom only in the absence of the physical stimulus. The cognitive state is still the same, with the only difference that the representation in WMterm·dom is arguably weaker and less precise due to the lack of informative sensory input. This extreme position is attractive due to its parsimony, but it is almost certainly wrong. We have already seen that perceptual attentionterm·dom to stimuli during the retention interval of a visual WMterm·dom task leads to less interference than adding the same stimuli to WMterm·dom ( Fougnie & Marois, 2006 ). I have also discussed instances where stimuli were attended to and yet they leave hardly any trace in WMterm·dom (H. Chen et al., 2016 ; H. Chen & Wyble, 2015a , 2015b ; OberauerpersName, 2018 ). Moreover, single-cell recordings from monkey LPFC neurons showed partial but not complete overlap between the neurons responding selectively to a feature while it is perceptually attended and those doing so while the feature is being held in WMterm·dom ( Mendoza-Halliday & Martinez-Trujillo, 2017 ). If we accept that perceptual attentionterm·dom and WMterm·dom are different entities, we can meaningfully ask how they causally affect each other.
How does perceptual attentionterm·dom affect WMterm·dom? Some authors have argued that perceptual attentionterm·dom can be used to rehearse visual or spatial WMterm·dom contents. The evidence for this idea is mixed. Some studies found a correlation between spontaneous eye movements during the retention interval – which presumably track visual attentionterm·dom – and recall success for sequences of spatial locations ( Tremblay, Saint-Aubin, & Jalberg, 2006 ), but no such correlation was found for change detection in visual arrays ( Williams, Pouget, Boucher, & Woodman, 2013 ). Directing people to attend to individual items in a visual array improves memory for those items relative to not-attended items in the array ( Souza, Rerko, & OberauerpersName, 2015 ; Souza, Vergauwe, & OberauerpersName, 2018 ). However, it is not clear whether this effect relies on perceptual attentionterm·dom. Engaging perceptual attentionterm·dom by a secondary task during the retention interval (i.e., detection of a slight brightness change in the fixation cross) impaired performance in a visual change-detection task ( Williams et al., 2013 ), but had at best a negligible effect on errors in a visual continuous-reproduction task, whereas engaging central attentionterm·dom impaired continuous reproduction more severely ( Souza & OberauerpersName, 2017 ).
As discussed above in the section on Filteringterm·key, perceptual attentionterm·dom is probably necessary but not sufficient for encoding of stimuli into WMterm·dom. Yet, filteringterm·key is not perfect, so that attended information is sometimes encoded into WMterm·dom to some extent even when this is not desired. To the extent that this happens, we can expect that distractors presented during the retention interval of a WMterm·dom task interfere with the to-be-remembered information, thereby impairing memory performance.
Evidence for such interference comes from studies of spatial WMterm·dom. Van der Stigchel, Merten, Meeter, and Theeuwes ( 2007 ) found that recall of locations is biased towards the location of a suddenly appearing irrelevant stimulus on the screen, suggesting that this stimulus was inadvertently encoded into WMterm·dom. Lawrence, Myerson, and Abrams ( 2004 ) had participants identify and compare two symbols during the retention interval of a WMterm·dom task, which either appeared at fixation or in the periphery (left or right of fixation). When the symbols appeared in the periphery, spatial (but not verbal) WMterm·dom performance was impaired more than for centrally displayed symbols. This suggests that attending to additional locations entails encoding these locations into WMterm·dom to some degree, thereby interfering with memory for other locations. The interfering effect was stronger when participants were instructed to move their eyes to the peripheral symbols than when they were instructed to maintain fixation, in line with other findings showing that processing distractors enforces stronger encoding into WMterm·dom than merely attending to them ( OberauerpersName, 2018 ). Both studies unfortunately lack a control condition in which irrelevant stimuli are presented but not attended, so it is not clear how much perceptual attentionterm·dom contributes to their encoding into WMterm·dom.
Does attending to a stimulus in the environment distract the focus of attentionterm·dom from information in WMterm·dom? Two observations indicate that it might not: The beneficial effect of a retro-cue directing the focus of attentionterm·dom to one item in WMterm·dom is not diminished by a subsequent task engaging perceptual attentionterm·dom ( Hollingworth & Maxcey-Richard, 2013 ; Rerko, Souza, & OberauerpersName, 2014 ). Likewise, the object-repetition benefit in a spatial WMterm·dom updating task was not diminished by requiring people to focus visual attentionterm·dom on a stimulus in the periphery in between updating steps ( Hedge, OberauerpersName, & Leonards, 2015 ). However, the retro-cue effect probably arises in part from strengthening of the cued item’s binding to its context, and this effect lasts after the focus of attentionterm·dom has moved away from the cued item ( Rerko et al., 2014 ; Souza et al., 2015 ). The same could be true for the object-repetition benefit: The item to be updated is selected into the focus of attentionterm·dom, and this strengthens the item’s binding to its context as a side effect, leaving that item temporarily more accessible than other items even if the focus of attentionterm·dom moves away from it. Evidence suggesting that attending to perceptual stimuli does distract the focus of attentionterm·dom comes from studies using multivariate neural signals to read out the information in the pattern of neural activity. The decodability of a single item in WMterm·dom is drastically diminished – at least temporarily – by the onset of an irrelevant stimulus, or just by the person attending to a location in anticipation of a stimulus, during the retention interval ( Bettencourt & Xu, 2016 ; van Moorselaar et al., 2017 ). However, in these studies the irrelevant stimulus hardly affected memory performance. Therefore, an alternative possibility is that the content of the focus of attentionterm·dom is represented in pre-frontal cortex ( Bichot et al., 2015 ), and the corresponding sensory representations are merely epiphenomenal, so that the elimination of the latter does not imply a distraction of the focus of attentionterm·dom in WMterm·dom.
To conclude, surprisingly little can be said with confidence: Perceptual attentionterm·dom to stimuli often – but not always – leads to them being encoded into WMterm·dom to some extent, so that they interfere with similar information. The use of perceptual attentionterm·dom for rehearsal has not been demonstrated convincingly. Whether the focus of attentionterm·dom can stay on an item in WMterm·dom while perceptual attentionterm·dom engages with a different stimulus in the environment is still unclear.
How does information in WMterm·dom affect perceptual attentionterm·dom? It appears plausible that holding some information in WMterm·dom tends to draw perceptual attentionterm·dom to similar information in the environment, thereby facilitating its processing. Initial evidence for that assumption comes from experiments by Awh et al. ( 1998 ): Holding the spatial location of an object in WMterm·dom facilitates processing of other stimuli appearing in the same location during the retention interval. A subsequent similar study taking additional measures to discourage eye movements, however, failed to replicate this finding ( Belopolsky & Theeuwes, 2009 ).
A more specific version of the same idea is the assumption that the item held in the focus of attentionterm·dom in WMterm·dom – usually a single item – functions as a “search templateterm·dom”, guiding perceptual attentionterm·dom to matching stimuli ( Olivers, Peters, Houtkamp, & Roelfsema, 2011 ). This idea has received considerable empirical support from studies of the “attentional capture” effect in visual search: When people are asked to hold an item in WMterm·dom – for instance a color, or just a color word – and carry out a visual search task during the retention interval, attentionterm·dom is drawn to stimuli in the search display matching the item in WMterm·dom ( Soto, Hodsoll, Rotshtein, & Humphreys, 2008 ). When more than one item is held in WMterm·dom and one of them is retro-cued, then only the retro-cued item causes attentional capture ( Mallett & Lewis-Peacock, 2018 ; van Moorselaar, Battistoni, Theeuwes, & Olivers, 2014 ; van Moorselaar, Theeuwes, & Olivers, 2014 ). This finding provides further evidence for the special functional status of representations in the focus of attentionterm·dom (i.e., the third level of selection).
How is WMterm·dom related to the control of attentionterm·dom and action?
Some theorists argue for a close relation of WMterm·dom specifically to controlled attentionterm·dom ( Kane et al., 2001 ; McVay & Kane, 2009 ; Unsworth et al., 2014 ). The evidence for this link comes primarily from correlations between measures of WMterm·dom capacity and controlled attentionterm·dom (reviewed above in the section on resourcesterm·key for attentionterm·dom control). There are at least two interpretations of this correlation. One is that people with high ability to control their attentionterm·dom are good at keeping irrelevant contents out of WMterm·dom ( Hasher & Zacks, 1988 ), either by filteringterm·key them out at encoding ( Vogel et al., 2005 ) or by removing them once they are no longer relevant ( OberauerpersName et al., 2012 ), and therefore they make better use of their WMterm·dom capacity. This account has difficulties explaining why measures of controlled attentionterm·dom were found to correlate substantially also with measures of (visual) WMterm·dom in which no irrelevant stimuli were presented, and no contents need to be removed from WMterm·dom ( Unsworth et al., 2014 ).
A second explanation, which I believe to be more promising, implies the reverse direction of causality. It starts from the assumption that the main function of WMterm·dom is to hold representations that control what we think and do, including what we direct our attentionterm·dom to ( OberauerpersName, 2009 ). For instance, in visual search perceptual attentionterm·dom can be controlled by holding a template of the search target in the focus of attentionterm·dom in WMterm·dom ( Olivers et al., 2011 ). Selection of responses to stimuli in accordance with the currently relevant task goal is accomplished by holding a task setterm·dom – a representation of the relevant stimulus categories, the response options, and the mapping between them – in WMterm·dom ( Monsell, 2003 ; OberauerpersName et al., 2013 ). In both cases, control could also rely on representations in long-term memory. For the case of visual search, Woodman, Carlisle, and Reinhart ( 2013 ) present strong evidence that search targets that repeat across successive trials are held in WMterm·dom only for the first few trials, after which search is controlled by target representations in long-term memory. The finding that search becomes more efficient with practice when the same set of stimuli is consistently used as targets or distractors further underscores the role of long-term memory in controlling perceptual attentionterm·dom in search tasks ( Shiffrin & Schneider, 1977 ). For the case of response selection, practicing a task with consistent stimulus-response mappings leads to long-term learning of these mappings, greatly improving task performance. Representations in WMterm·dom are necessary for control when we want to do something new – searching for a new target, or carrying out a new task that we just learned from instruction. WMterm·dom representations are particularly important when the new action is inconsistent with one that we have learned – for instance, searching for a target that used to consistently figure as distractor, or switching from one task to another that maps the same stimuli to new responses. In these cases, WMterm·dom provides a medium for building and maintaining new representations that control our cognitive processes and actions, if necessary countermanding our long-term knowledge. On these assumptions, the correlation between WMterm·dom capacity and performance in controlled-attention tasks arises because people with better WMterm·dom capacity have better (i.e., more robust, more precise) representations in WMterm·dom of the (cognitive or overt) action they intend to carry out, such as search templatesterm·dom and task setsterm·dom.
To conclude, I argue that WMterm·dom plays a crucial role in controlling attentionterm·dom and action by holding the representations that guide attentionterm·dom and action. The control process consists of selecting these representations into WMterm·dom – once they are established in WMterm·dom, they have their influence on attentionterm·dom and action automatically: Perceptual attentionterm·dom is “captured” by stimuli matching the content of the focus of attentionterm·dom even when this is only detrimental to performance in the current task ( Foerster & Schneider, 2018 ; Gao et al., 2016 ); newly instructed tasks, once implemented as task setsterm·dom in WMterm·dom, function like a “prepared reflex”, influencing response selection even when they are currently not relevant ( Meiran, Liefooghe, & De Houwer, 2017 ).
Conclusions Attentionterm·dom is closely related to WMterm·dom. Unpacking this relationship reveals many different ways in which the WM-attention link can be spelled out. A first divide is between theoretical ideas about attentionterm·dom as a resourceterm·key on the one hand, and about attentionterm·dom as a mechanism for selecting and prioritizing information on the other. The first approach entails the theoretical commitment that a limited attentional resourceterm·key is at least in part responsible for the capacity limit of WMterm·dom. This assumption has considerable empirical support but also significant weaknesses (for a reviewterm·mth see OberauerpersName et al., 2016 ), so that researchers should not endorse it as a default. The second approach does not imply a commitment to any assumptions about WMterm·dom or attentionterm·dom, and therefore offers a more neutral starting point for asking how the two are related. From the theoretical considerations and the evidence reviewed here I conclude that the following assertions about specific relations between attentionterm·dom and WMterm·dom are justified: By virtue of holding a selected subset of all available representations in memory, WMterm·dom is by definition a form of attentionterm·dom.
The selection of information to be held in WMterm·dom is a form of controlled attentionterm·dom: The selection of stimuli to be encoded into WMterm·dom is controlled by a filteringterm·key mechanism set according to our intentions; the retrieval of long-term memory information into WMterm·dom is gated to admit only information relevant for our current goals, and information no longer relevant for our current goal is removed from WMterm·dom.
Attending to a perceived stimulus probably facilitates encoding of that stimulus into WMterm·dom, but does not mandate it. Even attended information can be, to a large extent, filtered out.
Within the contents of WMterm·dom the focus of attentionterm·dom can be directed to individual items, or subsets of items, selected for manipulating them, or as input for processes (e.g., mental arithmetic, visual search).
Control of attentionterm·dom and action relies on representations in WMterm·dom that guide attentionterm·dom and action, such as search templatesterm·dom and task setsterm·dom, especially when these are new and in conflict with knowledge in long-term memory. Once established in WMterm·dom, these representations control attentionterm·dom and action independently of our intentions.
Unsurprisingly, there are also many things we don’t know. Table 2 presents a non-exhaustive list of open questions that I believe future research should address with high priority. I hope that this effort will lead to an increasingly more precise and nuanced picture of how WMterm·dom is related to attentionterm·dom.
Open Questions.