Accelerating dynamics of collective attention

Accelerating dynamics of collective attention

Abstract

With news pushed to smart phones in real time and social media reactions spreading across the globe in seconds, the public discussion can appear accelerated and temporally fragmented. In longitudinal datasets across various domains, covering multiple decades, we find increasing gradients and shortened periods in the trajectories of how cultural items receive collective attention. research_questionIs this the inevitable conclusion of the way information is disseminated and consumed? Our findings support this hypothesis. contributionUsing a simple mathematical model of topics competing for finite collective attention, we are able to explain the empirical data remarkably well. Our modeling suggests that the accelerating ups and downs of popular content are driven by increasing production and consumption of content, resulting in a more rapid exhaustion of limited attention resources. In the interplay with competition for novelty, this causes growing turnover rates and individual topics receiving shorter intervals of collective attention.

Introduction

It has long been argued quantitatively that technological developments are accelerating across a large number of domains from genomic sequencing 1 to computational power 2 and communication 3 . Described as part of a more general development termed social acceleration, the impact of these changes on the social sphere has more recently been discussed within sociology 4 . In the literature there have been hints of acceleration in different contexts 5 – 7 , but so far, the phenomenon lacks a strong empirical foundation 8 . While still new relative to many elements of contemporary society, big data has been a part of our culture long enough to enable measurements of longitudinal changes of our collective behavior 9 . object_of_studyHere, we propose a simple way to measure the pace of the dynamic allocation of collective attention through the ebbs and flows of popular topics and cultural items. By that we focus on one dimension of social acceleration, the increasing rates of change within collective attention 10 .

As an illustrative example, we begin by studying Twitter, which captures recent years (2013–2016) with high temporal resolution, then expand our analysis to a number of other systems. method↗content_tagsOur data sources cover multiple decades, as in Google Books (100 years), movie ticket sales (40 years), or citations of scientific publications (25 years). For the recent past, online media enable analysis with higher temporal granularity through Google Trends (2010–2018), Reddit (2010–2015), and Wikipedia (2012–2017) (see also Supplementary Table 1 ).

We use these dynamical measurements of categorized content as proxies for the amount of collective attention a topic receives. concepts↗sensescontent_tags↗Thus, we use the term collective attention in a sense that is closely related to the computational social science notion 11 – 13 , that measures various forms of population-level content consumption patterns 14 – 16 . concepts↗concept_edgesThis is distinct from the definition of attention used in cognitive psychology 17 , 18 , which describes the selective allocation of cognitive resource on an individual level.

Across the different domains under investigation, we find clear empirical evidence of ever steeper gradients and shorter intervals of collective attention given to each cultural item. By studying a variety of social domains, we emphasize the general nature of the observed development across both, domains and over time.

To probe the mechanisms underlying these dynamics, we model topics competing for attention 19 , 20 , driven by imitation 21 , 22 and saturation 12 , 13 , 15 , 23 , 24 , as a function of communication rates. Combining these factors in a minimal mathematical model based on modified Lotka–Volterra 25 , 26 dynamics reproduces the empirical findings surprisingly well. Our analysis suggests increasing rates of content production and consumption as the most important driving force for the accelerating dynamics of collective attention. concepts↗The resulting picture is an attention economy 11 , where the increasing abundance of information combined with the cognitive limitations and time constraints of users, leads to a redistribution of the available resources across time towards more rapid changes and higher frequencies.

Results

Hashtag peaks become increasingly steep and frequent

In order to measure the pace of collective attention, we start by defining observables to assess its dynamics. As a proxy for the popularity of a topic in Twitter, we use the time series of occurrence counts L i ( t ) of hashtag i (Fig. 1a ). content_tags↗The variable L refers to the term like as a measure for online-popularity and counts the number of usages of one hashtag i per time t (by any user). Here hashtags serve as a rough classification of content into different topics. controlsWe use a time resolution of 24 h in order to avoid noise from diurnal rhythms and the influence of different timezones. content_tagsWe consider the global top 50 used hashtags, sampled every recorded hour from a corpus of ~43 billion tweets 27 (our results are robust to the specific size of the top group, see Supplementary Fig. 1 ). controlsBy considering top groups of fixed size we ensure the same number of data points in each aggregation window, avoiding bias from increasing counts of simultaneous events. The choice of top groups also maximizes the size of the contributing population and minimizes the influence of locally heterogeneous user groups. Thus, we focus on globally visible topics, discussed around the world. Fig. 1 Measuring the speed of hashtag dynamics: a Daily usage L i ( t ) of the top 50 hashtags i on Twitter in 2016, with exemplary highlighted major events. b Average trajectories 〈 L ( t − t peak )〉 leading to a local maximum L i ( t peak ) in all top hashtags from 2013 to 2016. The shaded area shows the 95% confidence intervals (CI). In the background a 1% random sample of trajectories is shown in grey. c Temporal density of extreme events (local maxima with a lower threshold for the slopes, for details see Methods section), scattered over 365 days. d Distribution of daily relative losses P ( Δ L i ( l ) ∕ L i ) and e daily relative gains P ( Δ L i ( g ) ∕ L i ) . The solid lines show fitted log-normal distributions P ( x ) = 1 ∕ ( x σ 2 π ) exp - ( ln(x) - μ ) 2 ∕ ( 2 σ 2 ) (distributions truncated at 10 −3 ). Inset: The corresponding distributions of the local maxima of each hashtag trajectory P ( L i ( t peak )) (distributions truncated at 10 3 ). Source data are provided as a Source Data file and in an online repository (see data availability statement)

content_tagsAn early indication of systematic changes is growing transit rates of different hashtags through the top group. content_tagsThe numbers of hashtags passing through the top 50 (Supplementary Table 2 ) show that in 2013 a hashtag stayed within the top 50 for 17.5 hours on average, a number which gradually decreases to 11.9 hours in 2016 (details in the Methods section and Supplementary Table 2 ).

For more detailed investigations about long-term developments at a macroscopic level, we focus on statistical properties of the trajectories L i ( t ). The ensemble average trajectory of all hashtags 〈 L ( t − t peak )〉 (see Methods section for details) for the years 2013 to 2016, around local maxima L i ( t peak ), reveals a key property of the change in the dynamics of collective attention (Fig. 1b ). content_tagsThe average maximum popularity 〈 L ( t peak )〉 on one day t peak stays relatively constant, while the average gradients 〈Δ L 〉 in positive and negative direction become steeper over the years. The time required to achieve peak popularity decreases and the descent occurs symmetrically faster, shortening the period of each topic’s popularity.

To visualize the temporal density of the local maxima L i ( t peak ) we define bursts as extreme slopes toward a local maximum, directly followed by a fast decline (see Methods section for details). Figure 1c illustrates the size and the timing of burst occurrences, showing an increasing density of events from bottom to top.

Distributions of gains and losses are growing broader

Motivated by these qualitative observations, we define measures for velocities. The main observables for our investigation are the discrete empirical growth rates 16 , 28 . We divide them into relative gains [ Δ L i ( g ) ∕ L i ] ( t ) = ( L i ( t ) - L i ( t - 1 ) ) ∕ L i ( t - 1 ) > 0 and relative losses [ Δ L i ( l ) ∕ L i ] ( t ) = ( L i ( t ) - L i ( t + 1 ) ) ∕ L i ( t + 1 ) > 0 of each hashtag i and for all available time points t . controlscontent_tags↗Intentionally independent of the system size, relative velocity measures allow comparison across long time intervals and across different domains. An alternative measure is the logarithmic change log( L i ( t )/ L i ( t − 1)), which weighs large events less strongly, but provides similar results.

We analyze the two distributions of all losses and gains at all times in Fig. 1d, e , respectively. A good fit for both distributions is the log-normal distribution P ( x ) = 1 ∕ ( x σ 2 π ) exp - ( ln ( x ) - μ ) 2 ∕ ( 2 σ 2 ) (see Methods section and Supplementary Fig. 2 for alternative probability distribution functions). We find growing values of the fitted parameters σ and μ (values and testing results in Supplementary Table 3 ). The changes in σ and μ clearly quantify a systematic shift as well as the increasing skewness of the distributions, supporting the visual observations in Fig. 1b–e . Based on the formal definition of acceleration, we interpret changes of the logarithmic derivative Δ L / L to correspond to a nonzero second derivative of L i ( t ), i.e., an acceleration of collective attention dynamics. Since we observed stable average peak heights in Fig. 1b , we show the full distribution of maxima P ( L i ( t peak )) in the inset of Fig. 1e . The distribution is very broad (power-law like) and importantly, stays stable over time, corroborating the constant average value from Fig. 1b .

Acceleration across different domains

The acceleration is not unique to Twitter. content_tagsWe observe similar developments in a number of domains, online and offline, covering multiple time scales. concepts↗sensesWe measure various proxies for the collective attention given to individual cultural items in different data sources. We assume that whenever a topic is discussed (hashtags on Twitter, comments on Reddit, n-grams in books, citations of papers) or consumed (tickets for movies, queries on Google), it receives a small fraction of the available attention. Generally, we use the highest available granularity, considering yearly episodes whenever possible. In all datasets we focus on top groups, analogously to the Twitter analysis (see Supplementary Tables 1 and 2 , Fig. 2 and Supplementary Figs. 3 – 7 for more details). Fig. 2 Box-plot representation of relative gains in different data sets: The values of the relative gains Δ L i (g) ∕ L i , shown in a box-and-whisker representation for a Twitter, b Books, c Movies, d Google, e Reddit, f Publications, and g Wikipedia. The median is shown as a black bar and the mean as a black diamond. Whiskers are chosen to show the 1.5 of the interquartile range. In a the data points are included for illustration, in the other plots they are not shown. The insets show the same representation of the peak values L i ( t peak ) over the same time intervals (without mean value). Source data are provided as a Source Data file

More specifically: the books data consists of the yearly occurrences of individual n -grams ( n = 1, …, 5), normalized by the number of books they appeared in, from the Google books corpus 5 . The values are aggregated for periods of 20 years, to achieve good statistics despite the coarse granularity of the data. The movie data contains weekly box-office sales of Hollywood movies in the US, normalized by the number of theaters they were screened in, from Box office Mojo 29 . We use weekly data to avoid accounting for increases in sales towards the weekends. To reach reasonable sample size we aggregate the weekly data for periods of 5 years over the last four decades. The Google data comprises weekly search queries for individual topics from the monthly top charts normalized by the maximum within each category, from Google Trends 30 . Since the data only covers eight years we aggregate over a period of one year to obtain sufficient temporal granularity of measurements. The Reddit data consists of daily comment counts in the discussions attached to individual submissions on Reddit 31 , aggregated yearly from 2010 to 2015. The data regarding scientific publications is quantified by monthly citation counts of individual papers from the APS corpus 32 , aggregated for periods of 5 years, due to the coarser granularity, covering the last three decades. Wikipedia is described by the daily traffic on individual Wikipedia articles 33 , aggregated yearly from 2012 to 2017.

Despite the diversity of the datasets in terms of contextual background, timespan or size, Fig. 2 and Supplementary Figs. 2 , 3 and 4 show how the relative changes Δ L / L are similarly distributed, suggesting common underlying mechanisms. As noted above, the relative character of the observable Δ L / L compensates for many structural differences such as system size or normalization factors, enabling us to compare these systematic changes across different domains.

The box-plots in Fig. 2 show how the respective distributions of relative gains P ( Δ L i ( g ) ∕ L i ) undergo a long-term development in almost all datasets (Supplementary Figs. 3 and 4 for full distributions and Supplementary Tables 4 – 10 for the fitted parameter of the log-normal distributions). The growth of the median value and its increasing distance to the mean, as well as the growing upper boxes and whiskers describe a shift and an increasing skewness of the distributions. This represents, in agreement with observations for Twitter, a development towards overall steeper slopes and more extreme changes in collective attention for individual cultural items.

limitationscontent_tagsIt is important to note that we do not observe this development in an all considered datasets. For scientific citations and traffic on Wikipedia pages, there is negligible growth of relative gains and losses (Fig. 2f, g ). A possible explanation is that the driving mechanisms in these datasets are qualitatively different; that these knowledge-based systems are less governed by popularity or attention dynamics than the other data sources (see Supplementary note 1 for further discussion).

While we observe an increasing rate of change across systems, as it was the case for Twitter, the distributions of peak popularities P ( L i ( t peak )) remain stable. The development of the peak heights do not follow a clear trend (insets of Fig. 2 ) and for nearly all datasets they remain stable over time (see Supplementary Fig. 5 for full distributions, the exception of Wikipedia is discussed in Supplementary note 1). These robust observations across the data sources are further affirmed by visualizing burst events over time (Supplementary Figure 6 ) and decreasing average times between these events (Supplementary Figure 7 ).

content_tagsThe empirical work suggests three key findings: first, the peak heights of momentary popularity for individual topics are stable over time, second, the attention associated with individual topics rises and falls with increasing gradients and third, the shifts of collective attention between topics occur more frequent. This leads to broadening and shifting of distributions of relative changes in positive and negative direction. These observations are robust across a range of systems related to dynamics of collective attention, while knowledge communication systems appear to show much weaker developments.

Topics compete for finite collective attention

limitationsTo interpret these results, we formulate a deliberately minimal model that still captures key features of our empirical observations, with global parameters that we can interpret qualitatively in terms of real-world systems. This bare-bones model allows us to systematically investigate how the different empirical observations are connected and how they arise from system-level changes. sensesThe model is based on Lotka–Volterra dynamics for species (topics) competing for a common resource (attention) 25 , 26 . It describes the growth and shrinking of content volume L i ( t ). The growth is degraded by the competition with existing content about the same topic i from the past and by the competition with other topics j 1 d L i ( t ) d t = r p L i ( t ) 1 - r c K ∫ - ∞ t e - α ( t - t ′ ) L i ( t ′ ) d t ′ - c ∑ j = 1 , j ≠ i N L j ( t ) .

mechanismsconcepts↗concepts↗The dynamics of each topic i are governed by three basic mechanisms, proportional growth by imitation r p L i ( t ), self-inhibiting saturation \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\frac{{r_{c}}}{K}{\int}_{ - \infty }^t {\mathrm{e}}^{ - \alpha (t - t{\prime})}L_i(t{\prime})dt{\prime}$$\end{document} r c K ∫ - ∞ t e - α ( t - t ′ ) L i ( t ′ ) d t ′ and competition with other topics \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c\mathop {\sum}\nolimits_{j = 1,j \ne i}^N L_j(t)$$\end{document} c ∑ j = 1 , j ≠ i N L j ( t ) .

mechanismsconcepts↗concepts↗sensescontent_tags↗content_tags↗The exponential decay with rate α accounts for finite memory of the public, as recently observed 13 . Content regarding the topic i that has been produced in the recent past is consumed and contributes to its boringness. Occurrences in the distant past do not contribute, allowing for the reoccurrence of topics. The quantity K accounts for the carrying capacity from the classical population growth models and sets (together with the rates r p and r c ) the upper limit of growth. For simplicity, we set this parameter to 1 throughout the numerical analysis. The coupling strength c accounts for the amount of overlapping context. The lower c is, the more topics can coexist. For high values, the competition is fierce and topics can only grow if others decline.

concepts↗concepts↗content_tags↗content_tags↗The communication rates r p and r c are central in interpreting the model. Both are per capita growth rates and have the dimension of content per time. They label the rate of content creation ( r p , production) and the rate of consumption of the existing content ( r c , consumption). Considering the amount of information transfer over time is crucial because there is strong evidence that this quantity is increasing in real-world systems.

mechanismsconcepts↗The resulting dynamics can be separated into three phases within each of which a single mechanism is dominant: First, due to its novelty a topic gains advantage over existing topics and driven by imitation, the topic grows rapidly with rate r p (green curve in Fig. 3a ). Second, at some point a large amount of content on that topic exists, which is consumed at rate r c , exhausting the available attention for this topic. The boringness effect becomes dominant and attenuates its popularity (Fig. 3b ). Third, as the topic’s popularity decreases, resources are freed and the competition evokes newer topics j ≠ i to take over (Fig. 3c ). Fig. 3 Modeling attention dynamics: a – c Exemplary details of trajectories resulting from Eq. ( 1 ), imitation, saturation and competition. d Total amount of tweets observed per week that contain hashtags among the 50 most commonly used hashtags. Their number grows from two million in late 2013 to four million by the end of 2016. e Average trajectories 〈 L ( t − t peak )〉 leading to a local maximum L i ( t peak ) from the numerical solution of Eq. ( 1 ) with α = 0.005, c = 2.4 and N = 300 and varying r c = r p = r from 9.0 in yellow to 12.0 in dark blue, as indicated in the legend. f Intensity of bursts and timing. The radii of the circles encode the height of the peaks of extreme events. g Distribution of losses from the simulations (lines), compared with the empirical data from Twitter (symbols) and h distribution of gains (distributions truncated at 10 −3 ). The inset shows the overlap of the distributions of peak heights P ( L i ( t peak )) (simulated values are rescaled and truncated at 10 3 )

Faster communication causes temporal fragmentation

In Twitter, we observe a growing rate of tweets containing top hashtags per week (see Fig. 3d ). content_tagsThis is consistent with reports of increasing communication streams, reaching back 200 years 34 , covering modern telecommunication 35 up to the era of big data, where an annual growth rate of 28% of the world’s communication capacity within 20 years has been reported 3 . Increasing communication rates cause qualitative changes in the behavior of even a strongly reduced version of our model. To obtain an analytic understanding of the principal behavior of the system under the variation of the rates r p and r c , we consider a single topic without memory decay. Setting c = 0 and α → 0 we investigate the dynamics of an isolated topic presented to a audience with infinite memory. This single-topic case is analytically solvable and yields L ( t ) = 2 K r c r p e - r p ( t - t peak ) 1 + e - r p ( t - t peak ) 2 (see Methods section for details). The solution for a single topic resembles the derivative of a logistic growth process, known e.g., for the adopter dynamics in the theory of innovation diffusion 23 . This supports our interpretation of a growth process on a finite market of available collective attention. While increasing the growth rate r p is directly related to our empirical measurements of Δ L / L , the development of the consumption rate r c requires a more implicit argument. The maximum of L ( t ) for the isolated topic depends on the ratio r p / r c (see Methods section for details). Consequently, the stable peak heights in the empirical observation suggest that the rates of content production and consumption might be different, but increasing r p requires a proportional increase of r c to maintain this property (for simplicity we choose r c = r p ≡ r ). The parameter r controls the slopes, positive and negative; the peak heights stay stable but are reached more rapidly, again consistent with real-world observations (see Supplementary Figure 8a ).

mechanismsThis yields the following interpretation of the empirical findings for individual topics: The rate with which new content is created increases in proportion to the rate we consume content and exhaust attention (saturation). This causes gains of popularity to become steeper, while the saturation point is also reached more quickly. Thus, the peak height is conserved, but it is reached earlier and the phases of collective attention are shortened.

Returning to the empirical data, we consider a more realistic scenario of multiple, competing topics: The fully coupled system with finite memory effects Eq. ( 1 ) i.e., c > 0 and α > 0, is solved numerically. The dynamics can now become complex, exhibit chaotic behavior 36 , 37 , and characteristics of self-organized criticality 38 , 39 , with broad distributions of event sizes (see Supplementary note 2 and Supplementary Figure 9 ).

content_tagsWith the multitopic model in Eq. ( 1 ), we can now fit the model’s parameters to the gain distribution from 2016 and obtain an excellent fit with a Kolmogorov–Smirnov (KS) distance of 0.01 and a p value of 0.85 (see Methods section and Supplementary Table 11 for details). content_tagsRemarkably, changing a single parameter r for the in- and out-flux of information allows us to reproduce all other observations at once, for Twitter (Fig. 3e–h ) and for the other datasets by the same procedure (Supplementary Figs. 10 and 11 ). The agreement with real-world data and the simplicity of their interpretation make the results particularly persuasive.

All aspects of our observations on the various datasets are reproduced by the model. In Fig. 3e , the average trajectories show the same development as in the empirical findings (Fig. 1b ). mechanismsThe shortened popularity phases cause a more rapid release of resources to the competitors and topics rise up more frequently (Fig. 3f ). This corresponds to the observations in Fig. 1c and Supplementary Fig. 6 (Supplementary note 3 for an analytic approximation of the frequency). Importantly, none of the model’s other parameters preserves the peak heights and simultaneously increases the slopes under variation as r does. Supplementary Figure 12 shows that shorter memory (increasing α ) leads to higher peaks, stronger competition (larger c ) lowers the overall curve. Similarly an increasing number of overall discussed topics (larger N ) decrease slopes and peaks.

For a visual comparison of model and data, we overlay the shapes of the distributions of gains, losses and maxima in Fig. 3g , h. The excellent fit is confirmed through quantitative measures (see Supplementary Table 11 ) and is robust to alternative measures, such as the logarithmic changes (see Supplementary Figure 13 ). Thus, by fitting a single global communication rate we are able to capture the changing distributions of gains, losses, and peak heights, simultaneously.

Discussion

Over the past decades, many parts of modern society have become digitized, enabling researchers to study longitudinal changes to the dynamics of collective behavior. We have focused on content dynamics of cultural items, and our research supports the common experience 40 of ever faster flows of collective attention. The empirical findings we present are remarkably robust across many domains of public interest, covering a wide range of different time scales. They reveal significant changes in the statistical properties of collective attention dynamics. phenomenonThe gradients of content trajectories become steeper, but their peaks remain relatively stable, causing periods of individual popularity to become shorter.

claim_typemechanismscontent_tagsOur modeling suggests that shorter attention cycles are mainly driven by increasing information flows, represented as content production and consumption rates. As influx increases, individual topics are adopted more rapidly, leading to steeper rises in collective attention with the self-inhibitory effects of saturation resulting in an equally steepening downfall. Thus, in our modeling framework, producing and consuming more content results in shortening of attention spans for individual topics and higher turnover rates between popular cultural items. In other words, the ever-present competition for recency and the abundance of information leads to the squeezing of more topics in the same time intervals as the result of limitations of the available collective attention 11 .

A quantitative understanding of the factors behind the acceleration of allocation of collective attention has the potential to mitigate negative developments in modern communication systems caused by inflationary information flows. We expect these insights will spark research into the interplay between social acceleration and the fragmentation of public discourse and its potentially negative consequences 41 – 43 .

Methods

Empirical analysis

In order to measure the acceleration in our diverse ensembles of trajectories, we use statistical methods (e.g., ensemble averages) as a rough estimate, and the distributions of various observables for a more detailed picture. limitationssensesGenerally, we analyze groups of the most popular items, because we aim to observe topics that reach societal-scale awareness and avoid small and heterogeneous subgroups. This choice allows us to use a well-mixed modeling approach, without the need to account for possibly complex network structures in the onset of lesser known topics. This choice also assures a constant number of parallel events in each measurement. We choose group sizes that are particular to each data source according to their size and to achieve reasonable data densities. controlsWe tested for possible artifacts from the choice of absolute top groups, by considering relative top groups and thresholds, and found the developments reported in the main text to be robust against these choices (see Supplementary Figure 1 ).

The temporally discrete nature of empirical data requires us to chose a reasonable bin size to aggregate the timestamped occurrences. The minimal size we use is 24 h, starting from 00:00 and reaching to 23:59, to avoid confusing popularity dynamics with diurnal rhythms. If the data is only available in coarser granularity, we choose that binning size.

The aggregation windows of values, used to obtain the distributions for comparison, are chosen in a similar way. We generally compare distributions year-by-year and more generally, we choose aggregation windows for the losses, gains, etc. in the following way: if the data granularity is available on a daily level, we stick to the choice of yearly aggregation (e.g., in Twitter, Google, or Reddit). When the granularity of data points is coarser, e.g., weekly or yearly, we used wider aggregation windows, such as 5 or 20 years (e.g., Movies or Publications). This choice results in sample sizes that allow us to extract smooth distributions and cover the available time frame evenly.

Some of the observables depend on market size or infrastructure and cover long time scales. Whenever possible we choose observables to be independent of these influences. For example, we consider normalized proxies for popularity as in box-office sales and Google Books.

Sampling techniques

To measure collective attention we focus on popular and globally visible cultural items. On Twitter the acceleration developments appear weaker the lower the items are ranked (Supplementary Figure 1 ). A possible explanation for this behavior is additional mechanisms driving smaller popularity peaks, that are influenced differently, e.g., by social network structures or daily rhythms and less by the global news-spreading velocity. To focus on what we call collective attention we choose the following popularity-related samples. Twitter: From the set of hourly aggregated hashtag occurrences from altogether 43 billion individual tweets we sample the 50 most used of every hour. The resulting sample sizes are listed in extended data Supplementary Table 2 . The raw sampling counts already hint at the observed development: the total number of different hashtags ranked in the hourly top 50 within a year increases from 2013 to 2016. In 2013, for example, a hashtag has been part of the set of the top ranked hashtags on average for the period of (365 × 24 × 50)/25031 = 17.5 hours, while in 2016 it stayed only (365 × 24 × 50)/36703 = 11.9 hours. Hence, we can observe a development towards higher turnover rates in the popular discussion. This observation as well as the other results (Figs. 1 and 2 ) are stable with respect to changes in the size of the top group and become even more pronounced within the highest ranked hashtags (e.g., in the top ten of each hour, see Supplementary Figure 1 ).

For books, we extract the 1000 most frequently used n -grams from each year ( n = 1, ..., 5), normalized by the number of books in which they appear. A n -gram is a specific sequence of n character strings. Especially for higher n such n -grams are likely to correspond to a specific turn of phrase, related to a specific topic, if they are used several times per book. In this case the occurrences of phrases in books are taken to be a proxy for the attention that their authors spend on certain topics. Similarly to the usage of specific hashtags we take such phrases to be representations of topics of collective attention. The normalization per book allows a measurement that corresponds to the relative volume of a phrase usage without the total growth of the book market. Within the 20 year bins used in our investigation, we observe a similar effect in the raw counts as described above for Twitter: The number of different n -grams within the yearly top group over 20 years grows as listed in Supplementary Table 2 (the last number is smaller due to the shorter observation window of just 14 years).

As another example from the offline world we collected box-office sales (i.e., sold ticket prices) of popular Hollywood movies from the past four decades. This measurement is another quantification of the collective attention towards cultural items in form of movies. The more people view a given movie, the more collective attention it received. We average values by the number of theaters in which each movie is screened. This avoids a bias due to a growing number of cinemas. We use 4000 individual movies from the weekly top list of Box office Mojo 29 . Similar to previous datasets, the number of individual movies within the same time interval increases (Supplementary Table 2 ) (the last observation window is only 3 years).

For Google, we chose the top 20 search terms from every month in the period of 2005 to 2015 as they are listed from Google Trends topcharts. We use different categories, namely: people, songs, actors, cars, brands, TV shows and sports teams. We interpret the number of web-enquirers concerning these items as collective attention spent on them. In each category, five queries can be compared at once and their volume is normalized to the maximum among them. On the one hand this provides a normalization, but on the other hand the limitations from Google Trends imply that these values are not perfectly comparable. We overcome this by defining relative gains and losses as independent from system size, but note that, in this case, the distribution of maximum values in Supplementary Figure 5c is still non-trivial to interpret.

On Reddit we use as a popularity proxy the volume of discussion on submissions. The more a submission is discussed the more people are actively engaged by spending their attention to the particular topic. We extract the number of comments on each submission from the corpus of a 10% random sample from all comments on Reddit and focused on the top 1000 commented submissions of each month. The growing sample sizes again confirm the increasing turnover rates.

From the body of papers in the APS corpus we analyzed the citation counts of papers with more than 15 citations within a month. Whenever researches cite another work they are discussing a related idea, and by that focusing their attention on that topic. In this dataset any acceleration of citation dynamics is visible only for highly cited papers, we speculate that this because only the mechanisms of, e.g., imitation apply in this case (detailed discussion see Supplementary notes).

We also include the 100 most visited articles of every hour on the English Wikipedia in our analysis. Again, the active visit of a Wikipedia article is an act of focusing ones attention on the topic, described by the article. In the case of Wikipedia, we do not observe a pronounced development towards larger turnover rates within this definition of top articles. This is corroborated by the lack of strong changes in the other observables for this dataset (discussion see Supplementary notes ).

Average trajectories

From the dynamics of L i ( t ) of an entity i , we compute the ensemble average of the trajectories around local maxima L i ( t peak ) as a first step. The grey lines in Fig. 1b show 1% of of -trajectories L i ( t ) around a local maximum, contributing to an intuitive visualization of the dynamics in the Twitter dataset. The colored lines are the ensemble average values of all sub-trajectories L i ( t m ± t ) from each trajectory L i ( t ) around all its M i local maxima, at respective times t 1 … t M i for each year: ⟨ L ( t m ± t ) ⟩ = ∑ i = 1 N ( ∑ m = 1 M i L i ( t m ± t ) ∕ M i ) ∕ N . Evaluated three timesteps before and after the maxima, we observe long-term changes in the average values 〈Δ L 〉 and a relatively stable average height 〈 L ( t peak )〉. Following this insight we analyze and compare the statistical distributions of all the relative changes Δ L i / L i in each time step and the maxima L i ( t peak ) with respect to their long-term developments.

Distribution of relative changes P (Δ L i / L i )

For a more refined picture on the system level than the average of L i ( t ) around a local maximum, we examine the changes in popularity at every given point in time. In order to avoid trivial effects such as system size dependence, we do not consider the total changes Δ L i for measuring the velocity of attention allocation, but the relative gains Δ L i / L i in positive direction: [ Δ L i (g) ∕ L i ] ( t ) = ( L i ( t ) - L i ( t - 1 ) ) ∕ L i ( t - 1 ) > 0 at every instance t . Additionally we define the losses, symmetrically by reversing the order of events: [ Δ L i (l) ∕ L i ] ( t ) = ( L i ( t ) - L i ( t + 1 ) ) ∕ L i ( t + 1 ) > 0 . The normalized empirical distribution of relative losses P ( Δ L i (l) ∕ L i ) is plotted in Figs. 1d and 3g with an inverted x -axis to visually clarify their negative character (in Supplementary Figure 4 for the other datasets without that visualization). The distributions of gains P ( Δ L i (g) ∕ L i ) are shown in Figs. 1 e, 2 , S3 , and 3h . All plots are in double logarithmic scale and distributed among log-scaled bins.

Fitting continuous distributions

limitationsFinding a good fit for the distribution described above is not the central point of this work, but the correct fit contributes to a better understanding of the data. In addition, the fitted parameters reveal the visually observed developments quantitatively as listed in Supplementary Tables 4 – 10 . controlsTo find the best suited probability density function we use maximum likelihood fitting 44 considering an array of well known continuous distribution functions, namely: exponential, power-law, log-logistic (Fisk), Cauchy, normal, gamma, Pareto, logistic, uniform, Weibull, power-law with exponential cutoff, and log-normal. Supplementary Figure 2 shows the empirical data and the fitted candidate functions. For the optimal choice of distribution we consider the KS-statistics in order to quantify the goodness-of-fit. As listed in Supplementary Table 3 , the log-normal distribution is the best choice in most cases and is plotted using a thick red line. Other good candidates are the Pareto, the Weibull, and the log-logistic distribution. In the case of some of the datasets, these provide an even better fit (e.g., Pareto for Wikipedia). For simplicity we use the log-normal distribution: P ( x ) = 1 ∕ ( x σ 2 π ) exp - ( ln ( x ) - μ ) 2 ∕ ( 2 σ 2 ) in all cases. The corresponding KS-statistics are generally very small, they are listed alongside the detailed fitted values in Supplementary Tables 4 – 10 .

Since it is not the main point of this work to identify the exact shape of the distributions, we use box-and-whisker plots for the representation in Fig. 2 . Specifically, we use notched box plot representations, with median values shown as black bars and mean values as black diamonds. Whiskers are chosen to show the 1.5 of the interquartile range. The position of the median relative to the mean and the size of the upper box and whisker are good measures for the right-skewness of the data.

Distribution of maximal popularity P ( L i ( t peak ))

To quantify the observation of the average peak heights, the inset of Fig. 1e and S5 show the distribution P ( L i ( t peak )) of values of local maxima L i ( t peak ) from each trajectory. These plots are in double logarithmic scale with log-scaled bins. Corresponding box plots as described above are shown in the insets of Fig. 2 . Their shape has various characteristics, but generally the maxima are broadly distributed in all data.

Statistical testing

For the distributions of gains and losses we fitted a log-normal distribution to the data. This choice is based on the comparison of many candidate functions as described above and shown in Supplementary Figure 2 . To check the goodness-of-fit we use the two-sided Kolmogorov–Smirnov (KS) test 45 for continuous functions, which return low statistics values (Supplementary Tables 4 – 10 ) for all fits. The p values (for the hypothesis that the data is drawn from a log-normal distribution) vary largely and are generally small. In some datasets small sample sizes can contribute to the low- p values. As mentioned above the aim here is not to find the optimal probability density function to describe our data but to get an estimate for their broadness.

We also us the two-sided KS test for two samples to compare the distributions we obtain from the simulation to the empirically observed distributions. The distribution we aim to fit with the chosen parameters ( α = 0.005, c = 2.4, N = 300, and r = 12) is the gain distribution from Twitter in 2016. We reach a KS-distance of 0.01 and a p value of 0.85 (for the hypothesis that the two sets are drawn from the same distribution, Supplementary Table 11 ). Additionally we find that the distributions from the other datasets agree very well with our simulations (see Supplementary Figs. 10 and 11 , KS-statistics in the caption).

Burst events

Another way to demonstrate the development of accelerating media is to visualize the density of extreme events in collective attention dynamics. This can also be understood as a visualization of the broadening distributions of relative changes from Supplementary Figs. 3 and 4. content_tags↗We define this as an relative increase above a threshold, directly followed by a steep decline. These events can be understood as bursts or spikes. To define such an event in Twitter we detect a relative gain [ Δ L i (g) ∕ L i ] ( t burst ) > 5 followed by a loss [ Δ L i (l) ∕ L i ] ( t burst ) > 5 . For the other datasets we adjust these values to obtain a reasonable density of events for visualization (Google Books: 12, 12; Movies:1.5, 1.5; Google Trends: 2, 2; Reddit: 25, 25; Citations: 1, 1; Wikipedia: 35, 35). These values depend on the broadness of the gain and loss distributions and are chosen to track only the most extreme events (furthest points in the tail). The resulting bursts are plotted in Supplementary Figure 6 as scatter plots over time, for more recent times from bottom to top. The resulting average heights at the burst event 〈 L ( t burst )〉 and the time interval 〈 τ 〉 between them are shown in Supplementary Figure 7 . The developments are robust to the choice of slope thresholds.

Reducing dimensionality

The proposed model consists of N coupled distributed-delay differential equations that can be transformed into a system of 2 N ordinary differential equations. Introducing the auxiliary variable Y i ( t ) ≡ ∫ - ∞ t e - α ( t - t ′ ) L i ( t ′ ) d t ′ in Eq. ( 1 ) of the main text and applying the Leibniz rule, we obtain the transformed system: 2 d L i ( t ) d t = r p L i ( t ) 1 - r c K Y i ( t ) - c ∑ j = 1 , j ≠ i N L j ( t ) , 3 d Y i ( t ) d t = L i ( t ) - α Y i ( t ) .

This system can be solved numerically, using standard solvers like the Runge–Kutta method. The parameters for our simulations for the Twitter dataset are N = 300, α = 0.005, c = 2.4, K = 1.0 and using the condition for stable peak heights r p ~ r c we set r c = r p ≡ r , which we varied within a range r ∈ {9.0,10.0,11.0,12.0}.

limitationsThe interpretation of the numerical parameter values is not in the focus of the work, but they were optimized to fit the empirical distributions. The system size N = 300 contributes to a richer dynamic than using only, e.g., N = 50, the value of the memory decay α and the global competition coupling c are difficult to measure in empirical data, but a possible investigation in future research. The growth rates of Fig. 3d can not be mapped directly to the rate r p , because we measure global production rates, while r p describes a per capita growth per piece of content for each topic, but also this can be approached in the future. Generally, the qualitative results are very robust within wide ranges in the parameter space and the fitting is possible without extensively fine tuning the parameters.

After starting with random initial conditions ( L i (0) ∈ [0,1]) and empty memory ( Y i (0) = L i (0)), we allow for a transient of 500 time units in our simulations before starting the measurement. The finite memory makes self-sustaining dynamics possible without the constant introduction of new topics. limitationsIntroducing additional topics could be another variant of the simulation to account explicitly for exogenous driving by ever new events, but is not in the scope of this work. Solving the equations above results in N trajectories that can be analyzed for the same observables as the ones we observe in the datasets. We average over 100 realizations to obtain the statistical distributions, because ergodicity is not necessarily given. In Fig. 3a–c such trajectories are shown as examples, and in Fig. 3e the average values around local maxima are plotted. This plot is much smoother than the empirical one in Fig. 1b , because we are able to refine granularity of our time-discretization for the simulation. From this data it is straight forward to extract the extreme events (Fig. 3f ), the distributions of gains and losses (Fig. 3g–h ) or the values of maxima (inset Fig. 3h , values rescaled to meet empirical distribution). The simulation parameters were chosen by parameter scanning to minimize the KS-distance (0.01) of the resulting relative gain distribution to the one observed in 2016 on Twitter. The other distributions then follow from that simulation and overlap well with the data. Only the parameter r is varied to fit the distributions of the earlier years. For the other datasets the same procedure is applied to achieve the fits in Supplementary Figs. 10 and 11 .

Analytic solutions for a single topic

To gain a deeper insight to the interplay of the two rates r p and r c , we consider the minimal scenario of the model, an isolated topic ( c = 0). This reduces Eq. ( 1 ) to: 4 d L ( t ) d t = r p L ( t ) 1 - r c K ∫ - ∞ t e - α ( t - t ′ ) L ( t ′ ) d t ′ , choosing the limiting case of infinite memory α → 0 leads to 5 d L ( t ) d t = r p L ( t ) 1 - r c K ∫ - ∞ t L ( t ′ ) d t ′ , which can be written as: 6 d L ( t ) d t = r p L ( t ) 1 - r c K Y ( t ) 7 d Y ( t ) d t = L ( t ) .

The chain rule yields 8 d L ( t ) d Y ( t ) = r p 1 - r c K Y ( t ) , which leads to (with the necessary condition L ( Y = 0) = 0) 9 L ( t ) = r p Y ( t ) - r p r c 2 K Y ( t ) 2 = d Y ( t ) d t .

This first-order equation can be solved with the substitution v ( t ) = Y ( t ) −1 and has the solution: 10 Y ( t ) = r c 2 K + C e - r p t - 1 .

With the condition Y ( t peak ) = lim t → ∞ 1 2 Y ( t ) = K ∕ r c for logistic growth processes, where t peak is the time when L ( t ) is maximal as we used for empirical data in the main text, this yields the solution: 11 Y ( t ) = r c 2 K + r c 2 K e - r p ( t - t peak ) - 1 = 2 K r c 1 + e - r p ( t - t peak ) - 1 , which directly leads to the solution for L ( t ): 12 L ( t ) = 2 K r c r p e - r p ( t - t peak ) 1 + e - r p ( t - t peak ) 2 .

The observation of stable peak heights becomes clear by considering the maximum: 13 L ( t ) ∣ d L ( t ) d t = 0 = L t peak = 2 K r p r c , which is independent of r under the assumption of the direct proportionality of the two rates r p ~ r c ≡ r . Eq. ( 9 ) is shown in Supplementary Figure 8a under this condition. This seems to be approximately true for the case of the full system (Eqs. ( 2 ) and ( 3 )), as the numerical results show in Fig. 3e .

In the opposite limit α → ∞, corresponding to an audience without any memory, Eq. ( 4 ) becomes 14 lim α → ∞ d L ( t ) d t = r p L ( t ) 1 - lim α → ∞ r c K ∫ - ∞ t e - α ( t - t ′ ) L i ( t ′ ) d t ′ = r p L ( t ) , corresponding to an exponential growth process. In this scenario, even the present state L ( t ) is immediately forgotten and does not contribute to the intra-specific competition, causing an unhindered growth.

Supplementary information

Supplementary Information Peer Review File

Source Data