Whose turn is it anyway? Latency and the organization of turn-taking in video-mediated interaction — TEI-tagged view

Lucas M. Seuren, Joseph Wherton, Trisha Greenhalgh, Sara E. Shaw · 2021 · linguistics · doi:10.1016/j.pragma.2020.11.005 · TEI xml · tagged edition · index · concepts · authors
Where this record's text came from. 2026-09-27 schema-0.3 pass: every quote ON THIS RECORD verified as an exact substring of the staged text and anchored, at the merge dated above; concept terms verified present; every edge endpoint an existing node.
Other fields define these differently the same word, defined another way in another discipline
latency 2 fields · lapse 2 fields
Tags on this paper every tag the record carries, whether or not the words occur in the text below — a number is how many papers in the corpus carry that tag; a tag with no number is unique to this paper
latency19 gap lapse2 non-talk noticeable silence self-initiated self-repair increment transition-relevance place recognitional onset interjacent onset Overlap Resolution Device overlapping talk non-mutual realities interpretive24

Colour legend

Journal of Pragmatics<title level="j">A work — the journal / venue title.
2021<date>A year or date.

Lucas M. SeurenpersName, Joseph WhertonpersName, Trisha GreenhalghpersName, Sara E. ShawpersName (2021date). “Whose turn is it anyway? Latency and the organization of turn-taking in video-mediated interaction.” Journal of Pragmaticstitle·j.

Object of study — how latencyterm·dom disrupts turn-takingterm·key in video consultationsterm·key, and how participants deal with it

Research question — how latencyterm·dom interferes with the turn-takingterm·key system, how participants understand the resulting problems, and how they address them

Contribution — shows participants treat latency-caused silencesterm·key and overlapsterm·key as ordinary turn-takingterm·key failures, orienting to the call as instantaneous

Cross-disciplinary analysis
content-tags & facets: phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text
phenomenonturn-taking under latency — “Latency in video-mediated interaction can frustrate smooth turn-taking: it may cause participants to perceive silence at points where talk should occur, it may cause them to talk in overlap, and it impedes their ability to return to one-speaker-at-a-time.”
claim-typeexistence — “These findings show that the participants in our data were generally not aware of latency: they used overlap and silence resolution practices that treated these problems as turn-taking problems, not as latency problems.”
method — evidence — “We analyzed these data using Conversation Analysis ( Ten Have, 2007 ), focusing on how latency affected the interaction turn by turn ( Jefferson, 2004b ; Schegloff, 2000 ).”
object of study — evidence — “In this paper, we provide a detailed analysis of how participants in video-mediated interaction manage turn-taking problems that happen as a result of latency.”
research question — evidence — “By comparing video recordings of the patient's and clinician's side of the call, we provide a detailed analysis of how latency interferes with the turn-taking system, how participants understand problems, and how they address them.”
contribution — evidence — “We argue that how these problems emerge and the resolution practices participants use to address them show that the participants in our data orient to turn-taking in video-mediated interaction as instantaneous: they monitor and interpret both their interlocutor's vocalized and embodied behavior as if production and perception co-occur—that is, as if there were no latency.”
mechanismlatency It delays the answer, so a speaker perceives silence where the recipient has in fact responded. — “First, at a transition-relevance place, even if the recipient takes a turn and produces a next action, latency causes this answer to be delayed and the speaker to perceive silence.”mechanisms[0]
mechanismlatency It gives each participant a different point of overlap onset, which complicates overlap resolution. — “Second, when participants talk at the same time, their perception of where in their respective turns the overlap starts (i.e., the point of overlap onset) will differ.”mechanisms[1]
mechanismresolution practices Delayed resolution practices can create a new problem each time, prolonging the sequence. — “One problem that latency can cause for overlap resolution is that resolution practices are similarly delayed. This potentially leads to extensive sequences in which participants try to figure out who gets to talk.”mechanisms[2]
builds-on Sacks et al., 1974 — “Turn-taking is a basic organizational principle of human social interaction ( Levinson, 2016 ; Sacks et al., 1974 ). While the particulars of the turn-taking system vary between linguistic cultures, the underlying rules as described by Sacks, Schegloff, and Jefferson hold large cross-cultural sway ( Dingemanse and Floyd, 2014 ; Stivers et al., 2009 ).”claim_relations[0]
builds-on Ruhleder and Jordan, 2001 — “There are two “non-mutual realities” ( Ruhleder and Jordan, 2001 )—one for the nurse, and one for the patient—but both orient to their reality as a shared one.”claim_relations[1]
sensesilence - indistinguishable to participants whether it marks a withheld or a delayed response — “Indeed, it is precisely because these problems are familiar, that they are not easily recognized as technological problems: there is no way for participants to distinguish between silence that indicates a withheld response, and silence that indicates a delayed response. All silences sound the same.”senses[0]
senseoverlap - sometimes affiliative, as in recognition overlap, but often treated as deviant — “Some forms of overlap are in fact highly affiliative, such as recognition overlap, which can be used to display strong agreement ( Vatanen, 2018 ). However, participants often treat overlap as deviant from the norm and engage in interactional work to resolve it ( Drew, 2009 ; Jefferson, 2004b ; Schegloff, 2000 , 2001 ).”senses[1]
senseimmediacy - a taken-for-granted background assumption of communication — “Immediacy is a taken for granted background assumption of communication.”senses[2]
relationgap —contrasted-with→ lapse — Participants treat silences in these respective environments differently — “Participants treat silences in these respective environments differently. When turn-transition should happen a gap emerges (i.e., a failure by the recipient to take a turn in which to produce the projected action). When turn-transition could happen, a lapse emerges (i.e., the recipient foregoes an opportunity to talk) ( Hoey, 2020 ; Sacks et al., 1974 ).”concept_edges[0]
weightgap —contrasted-with→ lapse — 0.85 — “Participants treat silences in these respective environments differently. When turn-transition should happen a gap emerges (i.e., a failure by the recipient to take a turn in which to produce the projected action). When turn-transition could happen, a lapse emerges (i.e., the recipient foregoes an opportunity to talk) ( Hoey, 2020 ; Sacks et al., 1974 ).”concept_edges[0]
relationlatency —causes→ overlapping talk — latency causes (a) silence where talk should occur and (b) overlapping talk — “First, we analyze latency through the lens of the turn-taking system ( Sacks et al., 1974 ): we examine how at points of possible turn transition latency causes (a) silence where talk should occur and (b) overlapping talk.”concept_edges[1]
weightlatency —causes→ overlapping talk — 0.8 — “First, we analyze latency through the lens of the turn-taking system ( Sacks et al., 1974 ): we examine how at points of possible turn transition latency causes (a) silence where talk should occur and (b) overlapping talk.”concept_edges[1]
relationlatency —causes→ noticeable silence — latency caused speakers to perceive a noticeable silence — “In other words, our focus was on cases where latency caused speakers to perceive a noticeable silence, when there was no such silence for the recipient.”concept_edges[2]
weightlatency —causes→ noticeable silence — 0.8 — “In other words, our focus was on cases where latency caused speakers to perceive a noticeable silence, when there was no such silence for the recipient.”concept_edges[2]
replicationnot-applicable
no type for thislapse → overlapping talk — because the turn-taking system resolves a lapse by letting the speaker continue, a latency-caused lapse consistently ends in overlapping talk — “Because the solution provided by the turn-taking system is for the speaker to continue, the result consistently is overlapping talk, which then has to be resolved by one of the participants dropping out.”unhoused_relations[0]
no type for thisgaze → incipient speakership — a delayed gaze shift can be misread as signalling incipient speakership when it signalled attention — “However, he had already shifted his gaze at the start of her question (1b, line 6): his gaze reorientation does not indicate incipient speakership, but attention to her question.”unhoused_relations[1]
limitationSecondary analysis of a small dataset collected for another purpose, with many older and inexperienced users. — “Note, however, that while latency is a clear problem in our data, we conducted secondary analysis on a small data set, meaning that the data were collected for a different purpose, and that they involved many older people who had limited experience with video-mediated interaction.”limitations[0]
limitationParticipants' experience with video interaction could not be analysed systematically. — “Participants had a range of experience with video-mediated interaction, but due to the variation in latency across conversations, we could not analyze this systematically.”limitations[1]
Content tags
content-observations: finding · quantity · variable · definition · key-term — grounded in the full text
findingIn all but three cases speakers reinstated the transition-relevance place rather than blaming the technology. — “In all but three cases, speakers use practices that reinstantiate the transition relevance place. In these three exceptions, participants explicitly orient to the technology as the cause of the problem. However, in none of the three do they treat latency as the cause.”content_tags.findings[0]
findingMost overlaps were resolved quickly by one participant dropping out. — “In the majority of our data (147 cases), overlap is resolved quickly (in the other 25 one participant concedes the turn after both compete for it). One of the participants drops out within a few beats of overlapping talk.”content_tags.findings[1]
findingAround 100 ms latency barely affects turn-taking; around 700 ms participants struggle routinely. — “Our data suggests that with latency around 100 ms, turn-taking is barely affected, whereas with 700 ms, participants struggle routinely.”content_tags.findings[2]
findingUnderstanding the sequence often requires recordings of both ends of the call. — “Our analysis indicates that in order to get an adequate understanding of the sequential organization of video-mediated interaction, it is often necessary to have recordings of both ends of the conversation.”content_tags.findings[3]
quantity25 — — “Our final dataset consisted of 25 consultations, totaling 7 h and 57 min of interaction.”content_tags.quantities[0]
quantity130; 172 — — “Our final collection consisted of 130 cases of noticeable silence and 172 cases of overlap.”content_tags.quantities[1]
quantity33 — — “We identified 33 lapses that were caused by latency (extract (5) below provides a further example).”content_tags.quantities[2]
quantityabout 750 ms — — “Take the following extract from a video consultation between a patient with heart failure and his specialist nurse, where at this point the latency varies around 750 ms both ways.”content_tags.quantities[3]
quantity12.7 s — — “Between the first point of overlap onset and the patient resuming his turn, only 12.7 s have elapsed.”content_tags.quantities[4]
definitionlatency — “In this article we are concerned with latency , the technology-generated transmission delay between when a participant produces an action and when the co-participant(s) perceive that action.”content_tags.definitions[0]
key-termslatency, turn-taking, video-mediated interaction, Conversation Analysis, overlap, silence, gap, lapse, transition-relevance place, self-repair, gaze, video consultations
Concepts
terms this paper carries, each with the sentence it was cut from — the layer that joins one paper to another. Terms with no quote yet are on CONCEPTS.html.
conceptlatency — the technology-generated transmission delay between when a participant produces an action and when the co-participant(s) perceive that action — “In this article we are concerned with latency , the technology-generated transmission delay between when a participant produces an action and when the co-participant(s) perceive that action.”concepts[0]
conceptgap — a failure by the recipient to take a turn in which to produce the projected action — “Participants treat silences in these respective environments differently. When turn-transition should happen a gap emerges (i.e., a failure by the recipient to take a turn in which to produce the projected action). When turn-transition could happen, a lapse emerges (i.e., the recipient foregoes an opportunity to talk) ( Hoey, 2020 ; Sacks et al., 1974 ).”concepts[1]
conceptlapse — the recipient foregoes an opportunity to talk — “Participants treat silences in these respective environments differently. When turn-transition should happen a gap emerges (i.e., a failure by the recipient to take a turn in which to produce the projected action). When turn-transition could happen, a lapse emerges (i.e., the recipient foregoes an opportunity to talk) ( Hoey, 2020 ; Sacks et al., 1974 ).”concepts[2]
conceptnon-talk — silence at points where talk should occur — “The turn-taking system, in combination with the principles of sequence organization ( Schegloff, 2007 ), has implications for our understanding of talk as well as our understanding of silence at points where talk should occur (i.e., non-talk) ( Lerner, 2019 ; Sacks et al., 1974 ).”concepts[3]
conceptnoticeable silence — when participants orient to that silence as the noticeable absence of talk — “A silence becomes a noticeable silence when participants treat it as such, that is, when participants orient to that silence as the noticeable absence of talk (e.g., by pursuing a response).”concepts[4]
conceptself-initiated self-repair — The speaker identifies a problem (or “trouble”) with their talk and provides the solution for that trouble — “In the overwhelming majority of our data, speakers correct or clarify (part of) their turn, that is, they perform self-initiated self-repair ( Bolden et al., 2012 ). The speaker identifies a problem (or “trouble”) with their talk and provides the solution for that trouble ( Kitzinger, 2013 ; Schegloff et al., 1977 ).”concepts[5]
conceptincrement — another constituent that continues that turn — “Following syntactic completion of her turn, the doctor adds another constituent that continues that turn, in this case the noun phrase the pen type of insulin (i.e., she adds an “increment” to her initial question) ( Ford et al., 2002 ; Schegloff, 2016 ).”concepts[6]
concepttransition-relevance place — each point where a speaker's turn came to possible completion — “We examined silences at each point where a speaker's turn came to possible completion (the transition-relevance place).”concepts[7]
conceptrecognitional onset — when a next speaker comes in at a point where they recognize what the speaker is going to say — “Overlap can occur at different structural positions in the construction of the turn ( Drew, 2009 ; Jefferson, 1973 , 1984b , 1986 , 2004b ; Vatanen, 2018 ): (i) when a next speaker comes in at a point where they recognize what the speaker is going to say (what is called recognitional onset ) 6 ; (ii) when a next speaker produces a turn at the same time as a current speaker continues ( transition space onset ); (iii) when a next speaker begins a turn just after current speaker has continued ( post-transition onset ); and (iv) when a next speaker begins a turn at a point where current speaker is recognizably not approaching completion ( interjacent onset ).”concepts[8]
conceptinterjacent onset — when a next speaker begins a turn at a point where current speaker is recognizably not approaching completion — “Overlap can occur at different structural positions in the construction of the turn ( Drew, 2009 ; Jefferson, 1973 , 1984b , 1986 , 2004b ; Vatanen, 2018 ): (i) when a next speaker comes in at a point where they recognize what the speaker is going to say (what is called recognitional onset ) 6 ; (ii) when a next speaker produces a turn at the same time as a current speaker continues ( transition space onset ); (iii) when a next speaker begins a turn just after current speaker has continued ( post-transition onset ); and (iv) when a next speaker begins a turn at a point where current speaker is recognizably not approaching completion ( interjacent onset ).”concepts[9]
conceptOverlap Resolution Device — either one of the participants drops out after one or two beats (eg, syllables), or they use practices to compete for the turn (e.g., faster or louder talk) — “When overlap does happen, participants attempt to solve it quickly, applying an “Overlap Resolution Device”: either one of the participants drops out after one or two beats (eg, syllables), or they use practices to compete for the turn (e.g., faster or louder talk) ( Jefferson, 2004b ; Schegloff, 2000 , 2001 ).”concepts[10]
conceptoverlapping talk — not defined in this paper's own words; two participants talking at once, which turn-taking normally keeps to a minimum — “The turn-taking system is also used to minimize overlapping talk: to maintain the norm of “one-speaker-at-a-time” ( Sacks et al., 1974 ).”concepts[11]
conceptnon-mutual realities — not defined in this paper's own words; each participant's separate version of the call, which latency makes diverge while both take it as shared — “There are two “non-mutual realities” ( Ruhleder and Jordan, 2001 )—one for the nurse, and one for the patient—but both orient to their reality as a shared one.”concepts[12]

Full text — tagged

The reference list is not part of the text we hold for this paper. Our copy was extracted from the publisher's page and the bibliography did not survive that extraction, so the article below ends before its references. Nothing has been removed by us.

Whose turn is it anyway? Latencyterm·dom and the organization of turn-takingterm·key in video-mediated interactionterm·key Abstract Latencyterm·dom in video-mediated interactionterm·key can frustrate smooth turn-takingterm·key: it may cause participants to perceive silenceterm·key at points where talk should occur, it may cause them to talk in overlapterm·key, and it impedes their ability to return to one-speaker-at-a-time. Whilst potentially frustrating for participants, this makes video-mediated interactionterm·key a perspicuous setting for the study of social interaction: it is an environment that nurtures the occurrence of turn-takingterm·key problems. For this paper, we conducted secondary analysis of 25 video consultationsterm·key recorded for heart failure, (antenatal) diabetes, and cancer services in the UK. By comparing video recordings of the patient's and clinician's side of the call, we provide a detailed analysis of how latencyterm·dom interferes with the turn-takingterm·key system, how participants understand problems, and how they address them. We conclude that in our data latencyterm·dom unnoticed until it becomes problematic: participants act as if they share the same reality.

Introduction Research on video-mediated interactionterm·key has long recognized the problems that technology and a lack of shared physical space (the “fractured ecology”) pose for conversational participants ( Heath and Luff, 1993 ; Hindmarsh et al., 1998 ; Luff et al., 2003 ; Rintel, 2013 , 2015 ). In this article we are concerned with latencyterm·dom , the technology-generated transmission delay between when a participant produces an action and when the co-participant(s) perceive that action. The effects latencyterm·dom has on smooth turn-takingterm·key have featured centrally in a range of studies of social interaction ( Olbertz-Siitonen, 2015 ; Ruhleder and Jordan, 2001 ; Rusk and Pörn, 2019 ; Schoenenberg et al., 2014 ; Tang and Isaacs, 1993 ).

The problems participants experience with turn-takingterm·key in video-mediated interactionterm·key are of significant benefit to scholars of social interaction. The setting provides something of a natural breaching experiment ( Garfinkel, 1967 ): provided the latencyterm·dom is long enough to have a noticeable impact on the interaction—noticeable to the analysts, not the participants–participants find themselves in an environment where unbeknownst to them, their background assumption that turn production and turn perception occur simultaneously no longer applies ( Ruhleder and Jordan, 2001 ). As a result, they routinely have to solve basic interactional problems. Precisely because latencyterm·dom frustrates smooth turn-takingterm·key, we are provided with a treasure trove of phenomena and practices that are rare in instantaneous interaction.

In this paper, we provide a detailed analysis of how participants in video-mediated interactionterm·key manage turn-takingterm·key problems that happen as a result of latencyterm·dom. In doing so we not only document systematically how latencyterm·dom affects video-mediated interactionterm·key (i.e., its procedural consequentiality) ( Arminen et al., 2016 ; Schegloff, 1991 ), but also contribute to the study of turn-takingterm·key and the practices by which participants address problems.

Turn-takingterm·key in co-present interaction Turn-takingterm·key is a basic organizational principle of human social interaction ( Levinson, 2016 ; Sacks et al., 1974 ). While the particulars of the turn-takingterm·key system vary between linguistic cultures, the underlying rules as described by Sacks, Schegloff, and Jefferson hold large cross-cultural sway ( Dingemanse and Floyd, 2014 ; Stivers et al., 2009 ). Conversational participants organize their talk through sequences of actions in which the norm is one-speaker-at-a-time. The turn-takingterm·key system is arguably one of the few true universals of communication. Organizing talk in an orderly and systematic way is a basic condition for people to develop and maintain an intersubjectively shared understanding ( Moerman and Sacks, 1988 ; Sacks et al., 1974 ; Schegloff, 1992 ).

The turn-takingterm·key system, in combination with the principles of sequence organization ( Schegloff, 2007 ), has implications for our understanding of talk as well as our understanding of silenceterm·key at points where talk should occur (i.e., non-talkterm·dom) ( Lerner, 2019 ; Sacks et al., 1974 ). Whilst some silenceterm·key is tolerated ( Stivers et al., 2009 ), upon completion of a turn in which the speaker has selected a participant to produce a specific next action (e.g., a question making relevant an answer), silenceterm·key will often be understood as the noticeable absence of that action ( Bolden et al., 2012 ; Goodwin, 1979 ; Lerner, 2003 ; Pomerantz, 1984 ; Schegloff, 2007 ; Stivers and Rossano, 2010 ). Speakers may treat such a noticeable silenceterm·mth as, for example, a refusal by the recipient to produce a next action ( Schegloff, 2002 ) or as foreshadowing a dispreferred or non-straightforward response ( Davidson, 1984 ; Kendrick and Torreira, 2015 ; Robinson, 2020 ; Sacks, 1987 ). Even when no next-speaker has been selected, silencesterm·key between turns where talk should occur will be understood as the noticeable absence of talk: one of the participants should “self-select” to produce a turn ( Hoey, 2020 ).

The turn-takingterm·key system is also used to minimize overlapping talkterm·dom: to maintain the norm of “one-speaker-at-a-time” ( Sacks et al., 1974 ). That is not to say that overlapping talkterm·dom does not happen—it frequently does. Some forms of overlapterm·key are in fact highly affiliative, such as recognition overlapterm·key, which can be used to display strong agreement ( Vatanen, 2018 ). However, participants often treat overlapterm·key as deviant from the norm and engage in interactional work to resolve it ( Drew, 2009 ; Jefferson, 2004b ; Schegloff, 2000 , 2001 ).

Turn-takingterm·key and latencyterm·dom People acquire the turn-takingterm·key system in co-present environments, in which turns will be heard and seen at the same time they are produced ( Ruhleder and Jordan, 2001 ). However, when there is latencyterm·dom, action production and perception no longer co-occur, and this has implications for participants’ ability to manage turn-takingterm·key ( Olbertz-Siitonen, 2015 ; Rusk and Pörn, 2019 ; Schoenenberg et al., 2014 ; Tang and Isaacs, 1993 ).

Video communication technologies such as Skype inherently suffer from some latencyterm·dom. The length of this transmission delay varies: It can be anywhere in the order of tens to hundreds of milliseconds, depending on the quality of the network and each participants' local internet connection. These delays may seem short, but in social interaction where participants work with split-second timing ( Jefferson, 1973 ) they quickly present problems. Take the following extract from a video consultationterm·key between a patient with heart failure and his specialist nurse, where at this point the latencyterm·dom varies around 750 ms both ways. The nurse is inquiring about the patient's medication. 1 Image 1 At first glance this extract seems unremarkable. The nurse asks a question in line 6. At the point where her turn comes to possible completion, the patient turns his gazeterm·key towards the screen, seemingly indicating that he is directing his attention to the nurse in response to the question and that he is about to answer ( Rossano, 2013 ). The nurse maintains her gazeterm·key direction and body orientation throughout the subsequent silenceterm·key, not producing an action and demonstrably awaiting his answer. When the patient does not respond after 1.2 s, the nurse pursues an answer by repeating the question. The patient does eventually answer, but in overlapterm·key with the nurse's response pursuit.

This case, however, highlights how latencyterm·dom can interfere with turn-takingterm·key. We made the transcript for (1a) using a recording from the nurse's end of the call. If we consider the patient's end, we get a very different picture. Image 2 The patient actually answers on time : there is only a micropause between question and answer (line 6–8). Latencyterm·dom affects the nurse's perception of the patient's behavior. First, she receives his vocal answer significantly later than he produces it: he perceives her turn about 750 ms after she produces it and consequently she perceives his response 1.5s after finishing her turn. Second, she sees him turn his gazeterm·key to the screen, directing his attention to her, upon completion of her question (see 1a). When recipients gazeterm·key towards the speaker, this “displays recipiency” ( Heath, 1984 ) and so may indicate an upcoming response ( Rossano et al., 2009 ): the patient's gazeterm·key shift at the point of turn completion may thus indicate to the nurse that he is about to answer. However, he had already shifted his gazeterm·key at the start of her question (1b, line 6): his gazeterm·key reorientation does not indicate incipient speakership, but attention to her question.

The nurse's unnecessary pursuit of a response reveals how participants are often not aware of latencyterm·dom as part of the interactional context. How the nurse makes sense of the patient's vocal and non-vocal actions reveals her assumption that turn production and perception co-occur—that is, she orients to the same turn-takingterm·key norms as in face-to-face interaction where co-occurrence of turn production and turn perception is a seen but unnoticed background assumption ( Garfinkel, 1964 ).

Whilst recent studies have shown that participants are, at least on some occasions, aware of some of the technical problems that video-mediated interactionterm·key poses ( Rintel, 2013 , 2015 ; Rusk and Pörn, 2019 ), in our data they proceed under the same seen but unnoticed background assumptions characteristic of face-to-face interaction. In extracts (1a-b) the nurse does not see, and in fact she cannot see, that she does not receive the patient's turn at the same time at which he produces it. Essentially participants in a video-mediated interactionterm·key have different life worlds ( Garfinkel, 1967 ; Luff et al., 2003 ; Pollner, 1975 ; Schutz, 1967 ) and neither is more or less accurate than the other. There are two “non-mutual realitiesterm·dom” ( Ruhleder and Jordan, 2001 )—one for the nurse, and one for the patient—but both orient to their reality as a shared one.

This paper contributes to our understanding of turn-takingterm·key in video-mediated interactionterm·key in two ways. First, we analyze latencyterm·dom through the lens of the turn-takingterm·key system ( Sacks et al., 1974 ): we examine how at points of possible turn transition latencyterm·dom causes (a) silenceterm·key where talk should occur and (b) overlapping talkterm·dom. Second, we analyze the embodied behavior of participants in these environments, showing that (a) participants also visually orient to these silencesterm·key as a failure with turn-takingterm·key and (b) latencyterm·dom causes visual cues to be misperceived and misunderstood (e.g., as in (1a-b)).

We argue that how these problems emerge and the resolution practices participants use to address them show that the participants in our data orient to turn-takingterm·key in video-mediated interactionterm·key as instantaneous: they monitor and interpret both their interlocutor's vocalized and embodied behavior as if production and perception co-occur—that is, as if there were no latencyterm·dom. We thus combine an emic and an etic perspective: demonstrating how participants make sense of these problems (emic), while revealing that this sense-making is discrepant with the actual source of the problems (etic). It is this combined perspective that drives our conclusion that these participants routinely treat the interaction as instantaneous, until latencyterm·dom noticeably interferes with turn-takingterm·key. Finally, we discuss the implications of these findings both for participants engaged in video-mediated interactionterm·key, as well as scholars interested in researching video-mediated interactionterm·key.

Materials and methods We conducted secondary analysis of data that were collected between 2015 and 2018 in two separate studies on video-mediated consultations ShawpersName et al., 2018 . The consultations were recorded in (antenatal) diabetes, cancer, and heart failure services in the UK, and were conducted using either consumer Skype or FaceTime. Patients ranged in age between 21 and 87, with younger patients (n = 18, median = 26 years) prevalent in diabetes services and older patients (n = 19, median = 72 years) prevalent in cancer and heart failure services. Participants had a range of experience with video-mediated interactionterm·key, but due to the variation in latencyterm·dom across conversations, we could not analyze this systematically. Because we were interested in how latencyterm·dom affects the interaction, we only included consultations for which we had recordings from the patient's home and the clinic so we could compare each “reality”. Our final dataset consisted of 25 consultations, totaling 7 h and 57 min of interaction.

We transcribed the data according to conventions by Jefferson (2004a) and Mondada (2018) , and compared the two ends of each consultation to collect instances of noticeable, post-turn completion silenceterm·key and of overlapping talkterm·dom.

We examined silencesterm·key at each point where a speaker's turn came to possible completion (the transition-relevance placeterm·dom). However, silenceterm·key can occur at these points even without latencyterm·dom. We needed to isolate cases in which the speaker attempted to resolve a post-completion silenceterm·key, where that silenceterm·key was caused by latencyterm·dom. In other words, our focus was on cases where latencyterm·dom caused speakers to perceive a noticeable silenceterm·mth, when there was no such silenceterm·key for the recipient. We therefore excluded cases where the recipient did not take a turn (i.e., where there was an actual failure in turn transition). In these cases, latencyterm·dom would merely prolong the noticeable silenceterm·mth. We did not take the length of a silenceterm·key as a criterion for inclusion. A silenceterm·key becomes a noticeable silenceterm·mth when participants treat it as such, that is, when participants orient to that silenceterm·key as the noticeable absence of talk (e.g., by pursuing a response).

As with silenceterm·key, overlapping talkterm·dom can occur in any social interaction ( Jefferson, 2004b ; Schegloff, 2000 ). To make sure we only included cases where the emergence of overlapterm·key and its resolution were affected by latencyterm·dom, we excluded cases where one participant was making a competitive bid for the turn by launching into a turn when their co-participant's turn was recognizably not reaching completion ( Drew, 2009 ; Jefferson, 1984b ; Vatanen, 2018 ).

Our final collection consisted of 130 cases of noticeable silenceterm·mth and 172 cases of overlapterm·key. Since silenceterm·key resolution strategies almost invariably caused overlapping talkterm·dom, most cases of noticeable silenceterm·mth are also in the collection of overlapterm·key.

We analyzed these data using Conversation Analysisterm·key ( Ten Have, 2007 ), focusing on how latencyterm·dom affected the interaction turn by turn ( Jefferson, 2004b ; Schegloff, 2000 ). We analyzed the interactional practices by which participants: (a) treated silencesterm·key as noticeable silencesterm·mth, and (b) attempted to resolve these silencesterm·key. We subsequently examined all cases of overlapping talkterm·dom, and then investigated (a) where overlapterm·key began for each participant, (b) the strategies they used to try to resolve overlapterm·key, and (c) where and how latencyterm·dom caused problems for these strategies.

Both studies from which data were drawn received ethical approval for a detailed analysis of video recordings of video consultationsterm·key. VOCAL was approved by the National Research Ethics Service Committee London–City Road and Hampstead in December 2014 (14/LO/1883) and OQTS by the South Central–Berkshire Research Ethics Committee in September 2015 (15/SC/0553). All participating staff and patients in both studies gave their informed consent to be audio and video recorded during consultations and for the data to be used for research purposes.

Results The turn-takingterm·key system provides for minimal silenceterm·key between turns and minimal overlapping talkterm·dom, and it has built-in repair mechanisms to address errors ( Jefferson, 2004b ; Sacks et al., 1974 ; Schegloff, 2000 ). However, the system is built for and applied in a (co-present) context in which recipients perceive turns at the same time as speakers produce them ( Ruhleder and Jordan, 2001 ). When latencyterm·dom is introduced, this causes two problems. First, at a transition-relevance placeterm·dom, even if the recipient takes a turn and produces a next action, latencyterm·dom causes this answer to be delayed and the speaker to perceive silenceterm·key. Second, when participants talk at the same time, their perception of where in their respective turns the overlapterm·key starts (i.e., the point of overlapterm·key onset) will differ.

Silenceterm·key where talk should occur In dyadic interaction, turn-transition at a possible completion point can either be normatively relevant , when the speaker has selected the recipient to produce a specific “type” of next action (e.g., by asking a question, the speaker selects the recipient to provide an answer), or it can be possible , when the speaker has completed their turn without sequentially implicating a specific type of next action ( Sacks et al., 1974 ; Schegloff, 2007 ). Participants treat silencesterm·key in these respective environments differently. When turn-transition should happen a gapterm·dom emerges (i.e., a failure by the recipient to take a turn in which to produce the projected action). When turn-transition could happen, a lapseterm·dom emerges (i.e., the recipient foregoes an opportunity to talk) ( Hoey, 2020 ; Sacks et al., 1974 ).

Silencesterm·key thus become problematic and are constituted as a specific type of silenceterm·key through the behavior of participants. In our data, both the practices used by participants to address silenceterm·key and the timing with which they implement these practices indicates they do not understand these silencesterm·key to be the result of latencyterm·dom, at least not initially. They overwhelmingly treat the silencesterm·key as failures with turn transition, 2 as silenceterm·key where either participant should or could have taken a turn. They thus do not orient to these silencesterm·key as silencesterm·key that routinely occur in video-mediated interactionterm·key as a result of latencyterm·dom.

Understanding and solving gapsterm·dom That latencyterm·dom affects turn-takingterm·key can best be seen when speakers treat a post-completion silenceterm·key as the noticeable absence of a projected next action: the recipient is not just heard to be not talking (cf. Hoey, 2020 ), but to be not responding at a point where a response was due ( Sacks et al., 1974 ; Schegloff, 2007 ). In all but three cases, we find that they use practices that provide the recipient a new opportunity to respond, that is, they reinstantiate the transition-relevance placeterm·dom. Throughout the post-completion silencesterm·key, the speaker of the last turn either maintains their gazeterm·key if they are looking at the screen, visibly awaiting a response, or they direct their gazeterm·key towards the screen after a few hundred milliseconds, before pursuing a response. By using these practices speakers orient to the silenceterm·key as the noticeable absence of a conditionally relevant response ( Schegloff, 2007 ).

There is a range of practices participants have at their disposal to address these silencesterm·key such as repeats (extract 1), response prompts (e.g., using a polar response particle such as yeah to pursue (dis)confirmation after a yes/no-type question) ( Heritage, 1984a ) (such as in extract (7) in supplementary material), or adjusting the preference organization of the question, orienting to the silenceterm·key as foreshadowing a dispreferred or non-straightforward response ( Davidson, 1984 ; Kendrick and Torreira, 2015 ; Robinson, 2020 ; Sacks, 1987 ) (e.g., by incrementally adding a tag question to a declarative question, such as in extract (8) in supplementary material).

In the overwhelming majority of our data, speakers correct or clarify (part of) their turn, that is, they perform self-initiated self-repairterm·dom ( Bolden et al., 2012 ). The speaker identifies a problem (or “trouble”) with their talk and provides the solution for that trouble ( Kitzinger, 2013 ; Schegloff et al., 1977 ). Take the following extracts from a diabetes consultation in which the doctor asks the patient to confirm that she has been prescribed NovaRapid, a quick-acting insulin that is to be taken with meals. Image 3 Note first that the patient responds on time: there is not even a beat of silenceterm·key between the doctor's question and her confirming answer (see 2b, line 3). However, the doctor perceives a silenceterm·key of 0.6 s (2a, line 3). Following syntactic completion of her turn, the doctor adds another constituent that continues that turn, in this case the noun phrase the pen type of insulin (i.e., she adds an “incrementterm·dom” to her initial question) ( Ford et al., 2002 ; Schegloff, 2016 ). With this incrementterm·dom she combines linguistic and embodied resources to depict how the NovaRapid is used. By producing the clarification as an incrementterm·dom, she re-completes her question and provides another opportunity for the patient to provide an answer, following the initial lack of a response. She uses self-initiated self-repairterm·dom to pursue a response, and by providing a clarification she treats patient's lack of uptake as the result of an understanding problem ( Bolden et al., 2012 ). She thereby reveals her understanding that an answer was due, but missing. In other words, by pursuing a response she treats the silenceterm·key as a failure with turn-takingterm·key, although in actuality it is a result of latencyterm·dom.

In all but three cases, speakers use practices that reinstantiate the transition relevance placeterm·dom. In these three exceptions, participants explicitly orient to the technology as the cause of the problem. However, in none of the three do they treat latencyterm·dom as the cause. Consider extracts (3a) and (3b), taken from the start of the consultation in (1a-b). 3 The patient asks a question, and when a response is not forthcoming, he provides an account for the silenceterm·key. Image 4 The patient produces a question in line 1, making an answer conditionally relevant. The nurse's disconfirmation is significantly delayed and the patient perceives 0.8 s of silenceterm·key (3a line 2) during which he maintains his gazeterm·key towards the nurse, demonstrably waiting for her to take a turn. He then remarks softly—possibly to the GP-researcher—that the nurse cannot hear him. He treats the silenceterm·key as the noticeable absence of a projected response. He does not, however, pursue a response. Instead he indicates there is a problem with the technology that causes the nurse to not hear him. Note that the account the patient provides for the silenceterm·key is not latencyterm·dom, but some form of audio trouble. He orients to the silenceterm·key not as indicating a delay, but as indicating no response at all.

Recurrently we find that participants in our data treat silenceterm·key at a point where turn transition is relevant, as a failure in the organization of turn-takingterm·key. They use practices to pursue a response, meaning they treat the response not as delayed due to latencyterm·dom, but as missing entirely. By treating these silencesterm·key as gapsterm·dom, they show that at least initially they are not aware of latencyterm·dom as the true source of the problem.

Solving lapsesterm·dom According to the rules of turn-takingterm·key, when a speaker reaches possible completion and has not selected a next speaker, turn transition is optional. Recipients will have primary rights to self-select, but they may forego this opportunity. The ensuing silenceterm·key will still be oriented to as silenceterm·key where talk should occur ( Hoey, 2020 ), but the turn-takingterm·key system provides for its resolution: if none of the recipients self-selects, then the current speaker may continue; and if the current speaker does not continue then “rounds of possible self-selection” ( Sacks et al., 1974 , p. 715) occur until the silenceterm·key is resolved (i.e., until either participant has self-selected).

We found that latencyterm·dom interfered with this system. At a point of possible completion where no next speaker has been selected, the current speaker may perceive a lapseterm·dom even though the recipient has already self-selected. The following example from a diabetes consultation illustrates how speakers perceive and deal with a lapseterm·dom where one does not occur. The patient has been talking for 1.5 min about a drug trial in which he took part. That story comes to potential completion in line 3, where he returns to describing the study and discusses the outlook ( Jefferson, 1978 ). 4 Image 5 The nurse receives the patient's story with a claim of understanding oh right ( Heritage, 1984b ) and subsequently uses okay to indicate her understanding that his story is done ( Beach, 1993 ). With this turn, she does not select the patient to produce a next turn, and so he can self-select. And indeed, the patient continues. He directs his gazeterm·key away from the screen, 5 and moves into a new TCU (4b, line 6) providing an acknowledgment token ( Jefferson, 1984a ) before continuing. However, due to latencyterm·dom the nurse perceives 0.5 s of silenceterm·key, during which she maintains her gazeterm·key towards the screen, perceiving the patient to be reorienting his gazeterm·key from left to right (i.e., to the screen and thus to her ( Luff et al., 2016 )), and then asks how the study affected the patient. She thus perceives a lapseterm·dom where one does not occur and resolves it by self-selecting.

The consequences of this perceived but not actual lapseterm·dom may seem small initially. There is some overlapping talkterm·dom before they resume one-speaker-at-a-time with the patient answering the nurse's question (4a, line 11). However, the patient does not return to the turn he had abandoned when the overlapterm·key happened. Instead, the talk moves away from the specifics of the study he was talking about. The opportunity to mention what he was going to mention does not arise afterwards and he does not create the opportunity for himself.

We identified 33 lapsesterm·dom that were caused by latencyterm·dom (extract (5) below provides a further example). Lapsesterm·dom provide a different problem for participants than gapsterm·dom. Latencyterm·dom causes speakers to perceive silenceterm·key at a point where recipients may self-select. This silenceterm·key is understood as the recipient foregoing the opportunity to take a turn, even when the recipient has in fact started talking. Because the solution provided by the turn-takingterm·key system is for the speaker to continue, the result consistently is overlapping talkterm·dom, which then has to be resolved by one of the participants dropping out. But that itself is not always straightforward. We now turn to how latencyterm·dom frustrates participants’ ability to accomplish overlapterm·key resolution.

Overlapping talkterm·dom The turn-takingterm·key system provides for minimal overlapping talkterm·dom ( Sacks et al., 1974 ). When overlapterm·key does happen, participants attempt to solve it quickly, applying an “Overlap Resolution Deviceterm·dom”: either one of the participants drops out after one or two beats (eg, syllables), or they use practices to compete for the turn (e.g., faster or louder talk) ( Jefferson, 2004b ; Schegloff, 2000 , 2001 ).

Overlapterm·key can occur at different structural positions in the construction of the turn ( Drew, 2009 ; Jefferson, 1973 , 1984b , 1986 , 2004b ; Vatanen, 2018 ): (i) when a next speaker comes in at a point where they recognize what the speaker is going to say (what is called recognitional onsetterm·dom ) 6 ; (ii) when a next speaker produces a turn at the same time as a current speaker continues ( transition space onset ); (iii) when a next speaker begins a turn just after current speaker has continued ( post-transition onset ); and (iv) when a next speaker begins a turn at a point where current speaker is recognizably not approaching completion ( interjacent onsetterm·dom ).

The implications of overlapterm·key happening at these various points can be markedly different. For example, when recognitional onsetterm·dom occurs, turn completion provides a natural point for current speaker to drop out and thereby to resolve overlapterm·key. However, when one participant launches a turn at an interjacent position, they are making an active claim to the turn when another already has the right, and this can require more competitive practices ( Schegloff, 2000 ). In video-mediated interactionterm·key, latencyterm·dom can cause participants to have different perceptions of the point of overlapterm·key onset and thereby of how to resolve it.

In the majority of our data (147 cases), overlapterm·key is resolved quickly (in the other 25 one participant concedes the turn after both compete for it). One of the participants drops out within a few beats of overlapping talkterm·dom. Extract (5) from a diabetes consultation illustrates this clearly. The nurse has just explained that while the patient had a slightly low potassium during her last blood test, there is no cause for concern. She then asks the patient for an update on her diabetes. Image 6 After the nurse's question (5a, line 4) comes to completion, she perceives a 0.6 s silenceterm·key during which she sees the patient gazing to her. She pursues a response by re-asking her question, using a full clause this time, treating the silenceterm·key as a gapterm·dom. The patient's response comes off in post-transition overlapterm·key, but the nurse continues undisturbed. After her response pursuit, the patient provides an answer and the sequence unfolds. From the patient's perspective, however, she responds with no delay (5b, lines 4–5), her gazeterm·key aversion coordinated with the start of a TCU (see also extract 4), and she perceives the onset of the overlapterm·key in the transition space. 7 She drops out before even finishing her polar response particle, yeah , with an audible glottal stop. Note that, although the patient concedes the turn to the nurse, she maintains her gazeterm·key away from the screen, likely indicating that she will resume or re-attempt to answer when the nurse completes her turn ( Jefferson, 2004b ). She seemingly recognizes the nurse's pursuit as a pursuit or at least as a second attempt at the same question.

The overlapping talkterm·dom here is a result of the nurse pursuing a response when, unbeknownst to her, one was already forthcoming. The trouble is quickly resolved. The patient quickly drops out, in line with what Schegloff (2000) finds for the resolution of overlapping talkterm·dom in face-to-face interaction. The majority of our cases runs off similarly: once overlapterm·key happens, one of the participants drops out within a few beats, often, as here, without either participant making a claim for the turn.

One problem that latencyterm·dom can cause for overlapterm·key resolution is that resolution practices are similarly delayed. This potentially leads to extensive sequences in which participants try to figure out who gets to talk. The following example from a heart failure consultation reveals how latencyterm·dom affects overlapterm·key onset and the problems it poses for overlapterm·key resolution. The patient has been explaining how his back pain affects his ability to perform household tasks and in line 1 he turns to talk about how he struggles to play croquet. 8 Throughout the sequence, both participants maintain a posture with focus on their screens (see Figs. 1 and 2, both taken following the overlapterm·key at line 16). Image 7 The patient's turn reaches possible completion for the first time at line 7. At the patient's end (left column), the nurse does not take a turn and silenceterm·key ensues. The patient then recompletes his turn by providing an incrementterm·dom ( Ford et al., 2002 ). In overlapterm·key with that incrementterm·dom, he hears the nurse asking for confirmation, which he then provides. His confirming yeah (line 12 at the patient's end, line 11 at the nurse's end) completes the sequence, and since neither subsequently takes a turn, a lapseterm·dom ensues. Both participants attempt to resolve this lapseterm·dom by self-selecting: the nurse begins to offer a potential solution to some of the patient's problems, and the patient starts to say that he will keep trying. But because of latencyterm·dom, neither participant can immediately notice that the other has self-selected. As a result, each has already produced a partial turn when they hear the other's turn, leading to interjacent overlapterm·key at both ends (i.e., the patient hears the nurse begin a turn in overlapterm·key with his, whereas the nurse hears the patient begin a turn in overlapterm·key with hers (lines 14–16)).

In this example, latencyterm·dom has a significant effect on participants’ perception of where overlapterm·key onset happens. It also frustrates their attempts to figure out who gets to talk next. First when the participants attempt to give the right to talk to the other party by abandoning their turn, subsequently when they explicitly grant the other the right to talk through what Jefferson (2004b) calls a repeat request , and finally when the patient attempts to self-select.

Both participants initially attempt to resolve the overlapterm·key by abandoning their turn after a few overlapping beats, but due to latencyterm·dom these strategies create a new problem. From the patient's perspective (left column), he drops out quickly after the nurse starts her turn, and so she continues talking (line 16) without him talking in overlapterm·key. However, from the nurse's perspective (right column), she stops talking after about two beats of overlapping talkterm·dom, and it is in fact the patient who can continue talking (line 16) without her talking in overlapterm·key. Whilst they solve the overlapping talkterm·dom by both dropping out, they are faced with another problematic silenceterm·key (line 17).

To move out of this silenceterm·key, one participant needs to self-select or grant the turn to the other, but again latencyterm·dom frustrates their moves for a solution. The patient first attempts to give the turn to the nurse: by saying sorry (line 18) he orients to his prior overlapping talkterm·dom as an interruption and acknowledges that the nurse has the right to talk. The nurse responds with go on (line 19), thereby asking the patient to continue his turn. Here the problem could have been resolved. After he has heard the nurse's turn, the patient recognizably restarts his turn by repeating I've got (line 15 and 22). However, because latencyterm·dom delays the nurse's perception of his restart, she perceives 0.5 s of silenceterm·key and then more actively prompts him to continue by repeating part of his turn: y'r gonna keep on . This prompt comes off in overlapterm·key the patient's restart. He abandons his turn and another silenceterm·key ensues.

This silenceterm·key, while still problematic, is more easily resolved. The nurse has now twice explicitly prompted the patient to continue his turn, and the patient has made a first attempt at doing so. Both have thus oriented to the patient as having the right to talk. The patient acknowledges the nurse's second prompt with yeah ( Jefferson, 2004b ) before restarting his turn for the third and final time. Although the nurse still perceives a silenceterm·key of 1 s between his second and third restart, she does not make a move to do anything in this silenceterm·key: she waits for the patient to continue.

The above example is perhaps extreme: there were only 15 cases in our dataset with so many overlapsterm·key and repeated attempts to fix them. We have included it here, because it reveals in detail how latencyterm·dom causes problems for the basic mechanisms of organizing social interaction. In chronological time it does not take the participants long to fix the problem of whose turn it is. Between the first point of overlapterm·key onset and the patient resuming his turn, only 12.7 s have elapsed. However, in interactional time it takes a lot of work. There are multiple extensive silencesterm·key and each participant uses multiple practices to resolve the halt in progressivity, running into new problems each time. This reveals how fundamentally latencyterm·dom frustrates smooth turn-takingterm·key and participants’ ability to solve problems as they arise.

Discussion We demonstrated in this paper in detail how latencyterm·dom causes problems for turn-takingterm·key. Building on previous work on latencyterm·dom ( Olbertz-Siitonen, 2015 ; Ruhleder and Jordan, 2001 ; Rusk and Pörn, 2019 ; Schoenenberg et al., 2014 ; Tang and Isaacs, 1993 ), we explored how latencyterm·dom in video-mediated interactionterm·key matters for the talk by focusing on how participants manage silencesterm·key in transition relevance places and overlapping talkterm·dom. First, by causing a delay between turn-production and turn-perception, latencyterm·dom causes speakers to perceive silenceterm·key where talk should, and in fact does happen. This problem can be exacerbated by re-orientation of recipient gazeterm·key, which is also delayed and therefore can be understood differently (e.g., gazeterm·key can signal incipient speakership, whereas it was done to signal attention to a new action). Second, when participants talk in overlapterm·key, latencyterm·dom causes them to have different perceptions of where overlapterm·key starts and it delays the overlapterm·key resolution strategies they implement. Often these problems are quickly resolved, but sometimes they lead to extended sequences before participants manage to resume one-speaker-at-a-time.

These findings show that the participants in our data were generally not aware of latencyterm·dom: they used overlapterm·key and silenceterm·key resolution practices that treated these problems as turn-takingterm·key problems, not as latencyterm·dom problems. Latencyterm·dom is thus well and truly part of the context of video-mediated interactionterm·key ( Arminen et al., 2016 ): it has procedural consequences ( Schegloff, 1991 ). An upshot is that video-mediated interactionterm·key can provide a natural breaching experiment ( Garfinkel, 1967 ) for turn-takingterm·key. Participants are recurrently faced with a basic structural-organizational problem, providing us as analysts with an invaluable resource to understand how participants address these problems.

Note, however, that while latencyterm·dom is a clear problem in our data, we conducted secondary analysis on a small data set, meaning that the data were collected for a different purpose, and that they involved many older people who had limited experience with video-mediated interactionterm·key. A study designed to investigate latencyterm·dom specifically could provide a more detailed understanding of (a) how long a delay needs to be before it starts to disrupt turn-takingterm·key, and (b) to what extent the length of the delay matters for different types of actions and turn-transitions. Furthermore, the COVID-19 pandemic has led to an enormous increase in the use of video-mediated communication. Early indications are that people are now far more aware of the problems that latencyterm·dom can cause. Indeed, it seems to be one of the main frustrations. Whether and if so how this emerging experience re-shapes the turn-takingterm·key rules for video-mediated interactionterm·key is unclear. Participants may become better at addressing the problems, and develop new turn-takingterm·key conventions that are optimized for the medium.

Upshot for study of video-mediated interactionterm·key Video-mediated interactionterm·key has been a subject of research for decades, and much of our social interaction has moved online as a result of the COVID-19 pandemic and social distancing protocols. Nonetheless, the literature around turn-takingterm·key in video is scarce and primarily about institutional talk. Since latencyterm·dom is omni-present, inter-turn silencesterm·key will always be longer in video-mediated interactionterm·key than they are for in-person or telephone interaction. However, what kind of silencesterm·key are tolerable and when video-mediated interactionterm·key can be understood as “smooth” has so far not been investigated. Our data suggests that with latencyterm·dom around 100 ms, turn-takingterm·key is barely affected, whereas with 700 ms, participants struggle routinely. Studies need to be set up to systematically address the nature of video-mediated turn-takingterm·key, focusing on its vocal, embodied and technological components in both dyadic and multi-party interaction. Given the challenge posed by social distancing protocols for data collection, such studies may prove difficult during the pandemic, but with screen capture software it should be possible to start exploring these questions in a more systematic way.

Our analysis indicates that in order to get an adequate understanding of the sequential organization of video-mediated interactionterm·key, it is often necessary to have recordings of both ends of the conversation. However, this is not always practically feasible. Participants may be far apart geographically (e.g., Ekberg et al., 2019 ; Licoppe, 2017 ; Licoppe and Morel, 2012 ; Rintel, 2013 , 2015 ), and it places a significant demand on the research team to travel to multiple locations to make recordings. In addition there are methodological considerations: participants do not have access to each other's reality ( Luff et al., 2003 ) and in order to get am emic perspective, we should focus on the individual's life world ( Olbertz-Siitonen, 2015 ).

For many questions, however, it is crucial that researchers have access to each side of the conversation, both what each participant sees, hears and does. 9 Participants are continuously asking the question “why that now” ( Schegloff and Sacks, 1973 ), and while there is one answer for each participants, for us as analysts there are as many answers as there are participants. An analysis of how a sequence unfolds and how structure emerges cannot be conducted when we rely on one side of the interaction.

Conclusion Immediacy is a taken for granted background assumption of communication. We have demonstrated in this paper that in video-mediated interactionterm·key, time and again latencyterm·dom disrupts the structural organization of the interaction. These problems also happen in face-to-face and other forms of synchronous, instantaneous interaction. Indeed, it is precisely because these problems are familiar, that they are not easily recognized as technological problems: there is no way for participants to distinguish between silenceterm·key that indicates a withheld response, and silenceterm·key that indicates a delayed response. All silencesterm·key sound the same. That participants manage to overcome these problems at all is then a testament to the robustness of the turn-takingterm·key system. No matter how significant the impact of latencyterm·dom is on the interaction, participants manage to resume normal turn-takingterm·key at some point, even if it takes some effort and frustration.

Funding This work was supported by the 10.13039/501100000272 National Institute for Health Research (NIHR) [grant number PB-PG-1216-20012]; the 10.13039/100014461 NIHR Biomedical Research Center , Oxford, UK [grant number BRC-1215-20008]; and the 10.13039/100004440 Wellcome Trust [grant number WT104830MA]. The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.

Author contributions Lucas SeurenpersName: Writing – Original Draft, Data Curation, Investigation Joseph WhertonpersName: Investigation, Writing – Review & Editing Trisha GreenhalghpersName: Funding acquisition, Writing – Review & Editing Sara ShawpersName: Supervision, Writing – Review & Editing, Project Administration.

Declaration of competing interest None.

Interpretive notes.
• Highlighted spans are tagged entities: persName (author), title (venue), placeName (place), date (year), and term (a key concept: domain / ai / method).
• Eponymous or retrospective terms (e.g. “Nash equilibrium”, “segregation”) do not appear in the original source and so are not highlighted — a deliberate choice (see Report 4).
• Some entries begin with a word in capitals. EVIDENCE CORRECTED means the finding still stands and it was our quotation that was wrong — it has been replaced. RETRACTED means the entry itself was wrong; it stays on the page, marked, with its reason, rather than being deleted. WITHDRAWN AND REPLACED means a corrected version of it appears in the entries below. Each mark carries its own reason, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it.
• Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote shown on the same row, so the borrowing can be checked against the thing borrowed from without leaving this page. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.
• Counts: 1 work · 1 date.
Meta-Tagging Project · record seuren2021-turn-taking-video.
© 2026 Shir Sivroni