| phenomenon | WEIRD sample non-representativeness— “Behavioral scientists routinely publish broad claims about human psychology and behavior in the world’s top journals based on samples drawn entirely from Western, Educated, Industrialized, Rich, and Democratic (WEIRD) societies.” |
| claim-type | critique— “Overall, these empirical patterns suggests that we need to be less cavalier in addressing questions of human nature on the basis of data drawn from this particularly thin, and rather unusual, slice of humanity.” |
| method — evidence | — “We pursued this question by constructing an empirical review of studies involving large-scale comparative experimentation on important psychological or behavioral variables.” |
| transfer | from experimental economics: the Ultimatum and Dictator Games - anonymous one-shot allocations of real money, built as economic instruments - used as the cross-cultural measure of fairness and punishment in small-scale societies— “Foremost among these experiments, the Ultimatum Game provides a pair of anonymous subjects with a sum of real money for a one-shot interaction.” | transfers[0] |
| mechanism | THE GAP BETWEEN A CLAIM'S SCOPE AND ITS EVIDENCE'S SCOPE IS THE PAPER'S FIRST SENTENCE: behavioral scientists ROUTINELY PUBLISH BROAD CLAIMS ABOUT HUMAN PSYCHOLOGY AND BEHAVIOR in the world's top journals BASED ON SAMPLES DRAWN ENTIRELY from Western, Educated, Industrialized, Rich, and Democratic societies. The claim is about the species; the evidence is about one corner of it— “Behavioral scientists routinely publish broad claims about human psychology and behavior in the world’s top journals based on samples drawn entirely from Western, Educated, Industrialized, Rich, and Democratic (WEIRD) societies.” | mechanisms[0] |
| mechanism | TWO ALTERNATIVE IMPLICIT ASSUMPTIONS ARE NAMED, AND THE STANDARD POPULATION IS PUT IN SCARE QUOTES: researchers - OFTEN IMPLICITLY - ASSUME that EITHER there is little variation across human populations, OR that these STANDARD SUBJECTS are as representative of the species as any other population - and then: ARE THESE ASSUMPTIONS JUSTIFIED? Two different premises would license the same practice, and the paper separates them before testing either— “Researchers – often implicitly – assume that either there is little variation across human populations, or that these “standard subjects” are as representative of the species as any other population. Are these assumptions justified?” | mechanisms[1] |
| mechanism | THE SAMPLE IS CHARACTERISED BY ITS POSITION IN THE DISTRIBUTION RATHER THAN BY ITS SIZE: the review suggests BOTH substantial variability across populations AND that these subjects are PARTICULARLY UNUSUAL compared with the rest of the species - FREQUENT OUTLIERS. Not merely narrow but atypical, and the two are separate findings— “our review of the comparative database from across the behavioral sciences suggests both that there is substantial variability in experimental results across populations and that WEIRD subjects are particularly unusual compared with the rest of the species – frequent outliers.” | mechanisms[2] |
| mechanism | THE VERDICT IS PUT IN SUPERLATIVE FORM AND SCOPED TO A PURPOSE: members of these societies, INCLUDING YOUNG CHILDREN, are AMONG THE LEAST REPRESENTATIVE POPULATIONS ONE COULD FIND FOR GENERALIZING ABOUT HUMANS. The qualifier is doing the work - they are not unrepresentative in general, but for one specific inferential use— “The findings suggest that members of WEIRD societies, including young children, are among the least representative populations one could find for generalizing about humans.” | mechanisms[3] |
| mechanism | A PRESUMPTION OF UNIVERSALITY IS DENIED A PRIORI GROUNDS, AND THE DOMAINS ARE NAMED FIRST: many of the findings involve domains ASSOCIATED WITH FUNDAMENTAL ASPECTS of psychology - HENCE THERE ARE NO OBVIOUS A PRIORI GROUNDS for claiming that a particular behavioral phenomenon is UNIVERSAL based on sampling from A SINGLE SUBPOPULATION. Being fundamental is shown not to license being universal— “Many of these findings involve domains that are associated with fundamental aspects of psychology, motivation, and behavior – hence, there are no obvious a priori grounds for claiming that a particular behavioral phenomenon is universal based on sampling from a single subpopulation.” | mechanisms[4] |
| mechanism | THE RECOMMENDATION IS A CHANGE OF MANNER RATHER THAN OF METHOD, AND THE SAMPLE IS DESCRIBED IN TWO ADJECTIVES: we need to be LESS CAVALIER in addressing questions of human nature on the basis of data drawn from this PARTICULARLY THIN, AND RATHER UNUSUAL, SLICE OF HUMANITY. `Thin` is about size and `unusual` about position, and the sentence needs both— “Overall, these empirical patterns suggests that we need to be less cavalier in addressing questions of human nature on the basis of data drawn from this particularly thin, and rather unusual, slice of humanity.” | mechanisms[5] |
| mechanism | A FIELD'S BOUNDARY IS DRAWN BY FIAT FOR THE PAPER'S OWN PURPOSES: the subject is the Western, and MORE SPECIFICALLY AMERICAN, undergraduates who form THE BULK OF THE DATABASE in psychology, cognitive science and economics, AS WELL AS ALLIED FIELDS - HEREAFTER COLLECTIVELY LABELED THE BEHAVIORAL SCIENCES. The category the whole critique is addressed to is created in a parenthesis— “In particular, it is about the Western, and more specifically American, undergraduates who form the bulk of the database in the experimental branches of psychology, cognitive science, and economics, as well as allied fields (hereafter collectively labeled the “behavioral sciences”).” | mechanisms[6] |
| mechanism | THE PAPER'S CENTRAL QUESTION IS PUT AS A QUESTION ABOUT WARRANT, NOT ABOUT FACT: given that scientific knowledge is LARGELY BASED ON FINDINGS FROM THIS SUBPOPULATION, we ask JUST HOW REPRESENTATIVE these typical subjects are in light of the available comparative database - HOW JUSTIFIED ARE RESEARCHERS IN ASSUMING A SPECIES-LEVEL GENERALITY FOR THEIR FINDINGS?— “Given that scientific knowledge about human psychology is largely based on findings from this subpopulation, we ask just how representative are these typical subjects in light of the available comparative database. How justified are researchers in assuming a species-level generality for their findings?” | mechanisms[7] |
| mechanism | THE EVIDENCE NEEDED TO CHECK THE CLAIMS IS RARER THAN THE CLAIMS, AND THE COMPARISON IS MADE EXPLICITLY: large-scale comparative studies are HIGHLY INFORMATIVE but RATHER RARE, ESPECIALLY WHEN COMPARED TO THE FREQUENCY OF SPECIES-GENERALIZING CLAIMS - so when they were absent the authors fell back on assemblies of two- and three-population studies. The asymmetry between how often a scope is claimed and how often it is tested is stated as a ratio— “Although such larger-scale studies are highly informative, they are rather rare, especially when compared to the frequency of species-generalizing claims. When such comparative projects were absent, we relied on large assemblies of studies comparing two or three populations, and, when available, on meta-analyses.” | mechanisms[8] |
| mechanism | THE SAMPLING UNIVERSE IS MEASURED RATHER THAN CHARACTERISED, AND ITS COMPOSITION IS THEN EXPLAINED BY THE AUTHORS' OWN GEOGRAPHY: 68% of subjects came from the United States and A FULL 96% from Western industrialized countries - and THE MAKE-UP OF THESE SAMPLES APPEARS TO LARGELY REFLECT THE COUNTRY OF RESIDENCE OF THE AUTHORS. Who is studied is traced to who is doing the studying— “A recent analysis of the top journals in six subdisciplines of psychology from 2003 to 2007 revealed that 68% of subjects came from the United States, and a full 96% of subjects were from Western industrialized countries, specifically those in North America and Europe, as well as Australia and Israel (Arnett 2008). The make-up of these… | mechanisms[9] |
| mechanism | A CATEGORY IS NAMED FOR WHAT WAS ASSUMED ABOUT IT RATHER THAN FOR WHAT IT IS: the domains at issue are those which have LARGELY BEEN ASSUMED, AT LEAST UNTIL RECENTLY, TO BE **DE FACTO** PSYCHOLOGICAL UNIVERSALS. The label records a presumption and its expiry date, not a property— “those domains which have largely been assumed, at least until recently, to be de facto psychological universals.” | mechanisms[10] |
| mechanism | A MODEL FAILS ON THE GAME AS PLAYED, IS MODIFIED UNTIL IT MATCHES, AND THE MODIFICATION BECOMES THE EXPLANATION: WHEN THEY MODELED THE ULTIMATUM GAME EXACTLY AS PLAYED, THEY DID NOT GET RESULTS MATCHING THE UNDERGRADUATE FINDINGS - HOWEVER, IF THEY ADDED REPUTATIONAL INFORMATION, the analysis predicted offers and rejections IN THE RANGE OF TYPICAL UNDERGRADUATE RESPONSES. The added ingredient was absent from the experiment it was fitted to— “With this seemingly robust empirical finding in their sights, Nowak et al. (2000) constructed an evolutionary analysis of the Ultimatum Game. When they modeled the Ultimatum Game exactly as played, they did not get results matching the undergraduate findings. However, if they added reputational information, such that players could know what… | mechanisms[11] |
| mechanism | AND THE CONCLUSION DRAWN FROM THE FITTED MODEL WAS ABOUT THE SPECIES: they concluded that the game REVEALS HUMANS' SPECIES-SPECIFIC EVOLVED CAPACITY for fair and punishing behavior - a claim about human nature resting on a model that had to be modified before it would reproduce one population's results— “They concluded that the Ultimatum Game reveals humans’ species-specific evolved capacity for fair and punishing behavior” | mechanisms[12] |
| mechanism | THE WHOLE PICTURE IS SAID TO HAVE BEEN OVERTURNED IN ONE SENTENCE, AND BY COMPARISON RATHER THAN BY THEORY: RECENT COMPARATIVE WORK HAS DRAMATICALLY ALTERED THIS INITIAL PICTURE. The correction came from widening the population, not from a better model— “Recent comparative work has dramatically altered this initial picture.” | mechanisms[13] |
| mechanism | THE ACRONYM IS DISCLAIMED IN A NUMBERED NOTE, WHICH IS THE PUREST CASE IN THE CORPUS OF A TERM DOING WORK ITS COINERS DENY INTENDING: we also use the term WEIRD throughout this paper TO REFER TO THE EXCEPTIONAL NATURE OF THIS SAMPLE, AND DO NOT INTEND ANY NEGATIVE CONNOTATIONS OR MORAL JUDGMENTS BY THE ACRONYM. They chose a word that means `strange`, put it in the title, and formally disavowed its ordinary meaning in a footnote— “We also use the term “WEIRD” throughout this paper to refer to the exceptional nature of this sample, and do not intend any negative connotations or moral judgments by the acronym.” | mechanisms[14] |
| contradicts | the assumption that standard (WEIRD) subjects represent the human species— “often implicitly – assume that either there is little variation across human populations, or that these “standard subjects” are as representative of the species as any other population. Are these assumptions justified? Here, our review of the comparative database from across the behavioral sciences suggests both that there is substantial… | claim_relations[0] |
| extends | Gergen 1973; Medin & Atran 2004; Norenzayan & Heine 2005; Rozin 2001; 2009; Sears 1986; Sue 1999— “Although we are certainly not the first to worry about the representativeness of prevalent undergraduate samples in the behavioral sciences (Gergen 1973; Medin & Atran 2004; Norenzayan & Heine 2005; Rozin 2001; 2009; Sears 1986; Sue 1999), our efforts to compile an empirical case have revealed an even more alarming situation than… | claim_relations[1] |
| contradicts | radical interpretivism and cultural relativity (e.g., Gergen 1973)— “Many radical versions of interpretivism and cultural relativity deny any shared commonalities in human psychologies across populations (e.g., Gergen 1973; see critique and discussion in Slingerland 2008, Ch. 2).” | claim_relations[2] |
| sense | standard subjects - the population treated as a default stand-in for the species, on an assumption the paper says is usually left implicit— “Researchers – often implicitly – assume that either there is little variation across human populations, or that these “standard subjects” are as representative of the species as any other population.” | senses[0] |
| sense | representative - the property the paper tests and denies, concluding WEIRD subjects are among the least representative populations available— “The findings suggest that members of WEIRD societies, including young children, are among the least representative populations one could find for generalizing about humans.” | senses[1] |
| sense | WEIRD - an acronym for five society-level attributes, introduced to name the population the behavioural database actually rests on— “It is about a truly unusual group: people from Western, Educated, Industrialized, Rich, and Democratic (WEIRD)1 societies.” | senses[2] |
| sense | `WEIRD` - AN ACRONYM WHOSE EXPANSION IS ITS DEFINITION. `samples drawn entirely from Western, Educated, Industrialized, Rich, and Democratic (WEIRD) societies.` Five criteria, all of them checkable against a sample, carried inside the word. A reader who meets the term anywhere reconstructs the definition from the letters - the opposite of `exosome`, whose name asserts an origin nobody can check (see `thery2018`).— “Behavioral scientists routinely publish broad claims about human psychology and behavior in the world’s top journals based on samples drawn entirely from Western, Educated, Industrialized, Rich, and Democratic (WEIRD) societies. Researchers – often implicitly – assume that either there is little variation across human populations, or that… | senses[3] |
| sense | THE COINERS DISCLAIM THEIR OWN PUN, IN AN ENDNOTE. `We also use the term “WEIRD” throughout this paper to refer to the exceptional nature of this sample, and do not intend any negative connotations or moral judgments by the acronym.` The acronym was built to spell an ordinary English word carrying a judgement, and the authors then spend a note saying the judgement is not meant. A name can be memorable BECAUSE of a connotation its coiners then have to repudiate - and the repudiation is filed where a citing author is least likely to carry it.— “We also use the term “WEIRD” throughout this paper to refer to the exceptional nature of this sample, and do not intend any negative connotations or moral judgments by the acronym.” | senses[4] |
| audit | generalizability —contrasted-with→ WEIRD samples — Audit 2026-09-28: DOUBTFUL - read against its full span and kept, but WEIRD populations are among the least representative for generalizing; contrasted-with is loose.— “The findings suggest that members of WEIRD societies, including young children, are among the least representative populations one could find for generalizing about humans.” | concept_edges[0] |
| note | WEIRD —same-as→ standard subjects — ONE POPULATION, TWO NAMES, AND THE NAMES DISAGREE ABOUT IT. 'standard subjects' is the field's own term, and the paper puts it in scare quotes; 'WEIRD' is the name the paper coins for the same people in order to deny that they are standard. Weight 0.8 - the co-reference is clear from the sentence, but the paper never writes 'X is also called Y'; it stages the two names against each other.— “Behavioral scientists routinely publish broad claims about human psychology and behavior in the world’s top journals based on samples drawn entirely from Western, Educated, Industrialized, Rich, and Democratic (WEIRD) societies. Researchers – often implicitly – assume that either there is little variation across human populations, or that… | concept_edges[1] |
| weight | WEIRD —same-as→ standard subjects — 0.8— “Behavioral scientists routinely publish broad claims about human psychology and behavior in the world’s top journals based on samples drawn entirely from Western, Educated, Industrialized, Rich, and Democratic (WEIRD) societies. Researchers – often implicitly – assume that either there is little variation across human populations, or that… | concept_edges[1] |
| for which use | limitation — the representativeness assessment itself: OUR EXAMINATION ... IS NECESSARILY RESTRICTED TO THE RATHER LIMITED DATABASE CURRENTLY AVAILABLE— “Our examination of the representativeness of WEIRD subjects is necessarily restricted to the rather limited database currently available.” | limitations[0] |
| for which use | limitation — the magnitude of the WEIRD problem: BECAUSE PROPER COMPARATIVE DATA ARE LACKING FOR MOST STUDIED PHENOMENA, WE CANNOT ACCURATELY EVALUATE THE FULL EXTENT OF HOW UNUSUAL WEIRD PEOPLE ARE - the bias cannot be sized for the reason it exists— “Second, we acknowledge that because proper comparative data are lacking for most studied phenomena, we cannot accurately evaluate the full extent of how unusual WEIRD people are.” | limitations[1] |
| for which use | limitation — the Americans-versus-other-Westerners contrast: WE COULD FIND NO SYSTEMATIC RESEARCH PROGRAM TO COMPARE AMERICANS WITH OTHER WESTERNERS, SO THE EVIDENCE PRESENTED IS ASSEMBLED FROM MANY SOURCES— “At present, we could find no systematic research program to compare Americans with other Westerners, so the evidence presented is assembled from many sources.” | limitations[2] |
| for which use | limitation — the completeness of the survey: WE HAVE SURELY OVERLOOKED RELEVANT MATERIAL— “Since we have surely overlooked relevant material, we invite commentators to add to our efforts in identifying phenomena which have been widely tested across diverse subpopulations.” | limitations[3] |
| for which use | limitation — any behavioural-science finding as a claim about humans: 96% of samples come from countries with 12% of the world's population— “This means that 96% of psychological samples come from countries with only 12% of the world’s population.” | limitations[4] |
| for which use | limitation — the sample composition as a methodological choice: the paper attributes it to the authors' country of residence— “The make-up of these samples appears to largely reflect the country of residence of the authors, as 73% of first authors were at American universities, and 99% were at universities in Western countries.” | limitations[5] |
| for which use | limitation — a Western sample as representative of Western populations: the paper states most are composed solely of psychology undergraduates— “Even within the West, however, the typical sampling method for experimental studies is far from representative. In the Journal of Personality and Social Psychology, the premier journal in social psychology – the subdiscipline of psychology that should (arguably) be the most attentive to questions about the subjects’ backgrounds – 67% of the… | limitations[6] |
| for which use | limitation — the participant pool as an approximation to humanity: an American undergraduate is stated to be over 4,000 times more likely to be a participant than someone outside the West— “In other words, a randomly selected American undergraduate is more than 4,000 times more likely to be a research participant than is a randomly selected person from outside of the West.” | limitations[7] |
| evidence status note | mechanism — This is the span the dangling repair extended earlier today - it had ended at "...allied fields (hereafter collectively labeled the", with the term missing, and the repair recovered “behavioral sciences” from the file. I had not read the paper at that point. Reading it now confirms the extension was exactly right: the category the entire critique is addressed to is created in that parenthesis.— “In particular, it is about the Western, and more specifically American, undergraduates who form the bulk of the database in the experimental branches of psychology, cognitive science, and economics, as well as allied fields (hereafter collectively labeled the “behavioral sciences”).” | mechanisms[6] |
| evidence status note | mechanism — RE-SLICED, and the qualifier is UNREACHABLE. The sentence continues "in situations with substantial reputational influence" - but the staged text reads "substantial reputainfluence. But, since the Ultimatum Game is tional typically played one-shot": 'reputational' is split, its halves fused and displaced across the following clause. Damage shape 5. I first tried ending at "substantial reputa", which the cut-word guard refused - correctly, since dodging a scramble by stopping inside a word is not a fix.— “They concluded that the Ultimatum Game reveals humans’ species-specific evolved capacity for fair and punishing behavior” | mechanisms[12] |
| evidence status note | mechanism — TRIMMED. The next sentence reads "Two unified projects (which we call Phase [RUNNING HEAD: Henrich et al.: The weirdest people in the world?] 1 and Phase 2) have deployed..." - the running head is spliced INSIDE the parenthesis, so the detail about 23 small-scale societies cannot be reached from a contiguous span.— “Recent comparative work has dramatically altered this initial picture.” | mechanisms[13] |
| study location | Russia (country) · wikidata · geonames— “This phenomenon, which is not observed in typical undergraduate subjects (who essentially never reject offers greater than half), has now emerged among populations in Russia (Bahry & Wilson 2006) and China (Hennig-Schmidt et al. 2008)” | study_location[0] |
| study location | Sweden (country) · wikidata · geonames— “2008), as well as (to a lesser degree) among non-student adults in Sweden (Wallace et al. 2007)” | study_location[1] |
| replication | untested |
| limitation | The review can only assess representativeness against the small comparative database that currently exists.— “Our examination of the representativeness of WEIRD subjects is necessarily restricted to the rather limited database currently available.” | limitations[0] |
| limitation | Because comparative data are missing for most phenomena, the true extent of WEIRD unusualness cannot be measured.— “Second, we acknowledge that because proper comparative data are lacking for most studied phenomena, we cannot accurately evaluate the full extent of how unusual WEIRD people are.” | limitations[1] |
| limitation | The Americans-versus-other-Westerners contrast rests on assembled scattered sources rather than any systematic comparative programme.— “At present, we could find no systematic research program to compare Americans with other Westerners, so the evidence presented is assembled from many sources.” | limitations[2] |
| limitation | The authors concede their coverage of relevant studies is incomplete.— “Since we have surely overlooked relevant material, we invite commentators to add to our efforts in identifying phenomena which have been widely tested across diverse subpopulations.” | limitations[3] |
| limitation | The sampling skew is quantified against world population: 96% of samples come from countries holding 12% of humanity.— “This means that 96% of psychological samples come from countries with only 12% of the world’s population.” | limitations[4] |
| limitation | The skew is stated to track where the authors live, not a sampling design.— “The make-up of these samples appears to largely reflect the country of residence of the authors, as 73% of first authors were at American universities, and 99% were at universities in Western countries.” | limitations[5] |
| limitation | Even within Western samples the method is stated to be far from representative, being mostly psychology undergraduates.— “Even within the West, however, the typical sampling method for experimental studies is far from representative. In the Journal of Personality and Social Psychology, the premier journal in social psychology – the subdiscipline of psychology that should (arguably) be the most attentive to questions about the subjects’ backgrounds – 67% of the… | limitations[6] |
| limitation | The over-representation is given as a per-person likelihood ratio of more than four thousand to one.— “In other words, a randomly selected American undergraduate is more than 4,000 times more likely to be a research participant than is a randomly selected person from outside of the West.” | limitations[7] |