standOff, and the article is at its publisher via the link below. When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote for that row; on this page it is withheld with the article, and the article is at its publisher. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.| relation to other work | claim_relations | how this paper stands to another: agrees, contradicts, extends, qualifies |
| claim type | claim_type | the shape of the claim: existence, mechanism, method, critique, prediction, null |
| concept edge | concept_edges | an asserted relation between two concepts, with the sentence asserting it |
| concept | concepts | an idea the paper works with, quoted where the paper uses it |
| content tag | content_tags | a finding, definition, quantity, statistic or variable named in the paper |
| contribution | contribution | what the paper claims to add |
| control | controls | an experiment run to eliminate a rival explanation |
| limitation | limitations | what the paper says its evidence cannot support |
| mechanism | mechanisms | how the reported effect is said to come about |
| method | method | how the paper produced its evidence |
| object of study | object_of_study | what the paper is about — the thing it investigates |
| phenomenon | phenomenon | the effect or regularity under study |
| research question | research_question | the question the paper sets itself |
| sense | senses | a distinct use of a term, quoted where the paper fixes it |
Relations on this page carry a quotation for the claim. Where a relation was separately evidenced — and so tested against the vocabulary for its type — the row says so; none of 4 relations here carry that mark. The rest are the tagger’s reading of the sentence quoted beside them.
| facet | tag | field | conf. | whose words |
|---|---|---|---|---|
| object_of_study | HOW TO MEASURE 'vaccine hesitancy' - a construct defined by the same working group, in the adjacent article of the same journal supplement, three months earlier Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | object_of_study | the paper's words | |
| research_question | what to ask, of whom, so that the scale and nature of hesitancy can be compared across countries - and how to keep the answer from counting refusal, or access failure, as hesitancy Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | research_question | the paper's words | |
| contribution | a compendium of survey questions in three forms - closed, Likert and open-ended - mapped onto the Determinants Matrix, plus two indicators piloted in the WHO-UNICEF Joint Reporting Form Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | contribution | the paper's words | |
| claim_type | method Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | claim_type | the paper's words | |
| phenomenon | hesitancy as a SUB-GROUP property rather than a population-wide one, so that the measurement has to answer WHO, WHAT and WHERE separately Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | phenomenon | the paper's words | |
| method | survey Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: survey | method | the paper's words | |
| mechanisms | the survey is built to separate three things a raw uptake figure cannot: REFUSAL, ACCESS FAILURE, and HESITANCY. `Counting only vaccine refusers will not capture hesitancy`, and the reasons for being unvaccinated must be assessed to tackle hesitancy `as distinct from access issues` Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | mechanisms[0] | 0.95 | the tagger's words |
| mechanisms | and it is built to be VACCINE-SPECIFIC, because the construct is: hesitancy `may be specific to one or some, but not all, vaccines`, so a survey answer must not be generalised across vaccines unless the question said so Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | mechanisms[1] | 0.95 | the tagger's words |
| limitations | THE DEFINITION IS RESTATED IN A NARROWER FORM THAN ITS OWN SOURCE PAPER USES. macdonald2015 writes `delay in acceptance or refusal of vaccination despite availability of vaccination services`; this paper's Discussion writes `delay in acceptance or refusal of vaccines despite availability of vaccine services`. macdonald2015 spent a paragraph choosing the narrower NAME while keeping the broader SENSE, and the breadth lived in exactly those two words Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | limitations[0] | 0.95 | the tagger's words |
| limitations | and the Introduction's block quotation differs from the source too, in two places: `A delay` for `delay`, and `time, place, and vaccines` for `time, place and vaccines`. Small, and they establish that THE DEFINITION IS BEING RE-TYPED RATHER THAN COPIED - which is how the third version becomes possible Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | limitations[1] | 0.95 | the tagger's words |
| limitations | THE FIRST INSTRUMENT MEASURED SOMETHING ELSE ON PURPOSE: the 2012 pilot focused on vaccine confidence `rather than on the broader issues driving vaccine hesitancy`, `in order to be in harmony with the Global Vaccine Action Plan indicators`. The instrument was aligned to a programme's reporting framework before it was aligned to the construct Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | limitations[2] | 0.95 | the tagger's words |
| limitations | the pilot it reports on had a 14% response rate - 13 of 94 countries - and the paper calls it `SUB-OPTIMAL` in its own first results sentence Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | limitations[3] | 0.95 | the tagger's words |
| limitations | THE QUESTIONS ARE LARGELY UNVALIDATED AND THE PAPER SAYS SO THREE TIMES: `few have been validated`; `Most are predominately designed for high-income settings`; and the questions `do not address all the determinants in the Vaccine Hesitancy Matrix` Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | limitations[4] | 0.95 | the tagger's words |
| limitations | and SAGE's own final report is quoted saying the compendium has been `assessed and validated only in some high-income countries or not at all` - a validation warning carried inside the paper that ships the instrument Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | limitations[5] | 0.95 | the tagger's words |
| limitations | the items are of MIXED PROVENANCE and it is declared: some `derived from previously validated questionnaires, albeit in high-income countries only`, some from experts, and `others are newly proposed`. Three evidential grades in one compendium, distinguishable nowhere in the instrument itself Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | limitations[6] | 0.95 | the tagger's words |
| limitations | and the construct is declared UNSTABLE IN TIME, which limits any single measurement: `A survey which reveals little hesitancy this year may have a different result next year` Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | limitations[7] | 0.95 | the tagger's words |
| limitations | the funding disclosure is IDENTICAL to its companion paper's, and lands on the same word: the group monitoring `public confidence in Immunization Programs` took Novartis research funding and GSK meeting funding, and the first author consulted for GSK ON VACCINE CONFIDENCE Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | limitations[8] | 0.95 | the tagger's words |
| controls | whether the instrument counts refusal, or access failure, as hesitancy Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. eliminates: both confounds AT THE LEVEL OF INSTRUCTION - the paper states that refusal is not hesitancy and that hesitancy must be assessed as distinct from access - but no item, scoring rule or threshold is given that would separate them in a returned survey · outcome: partial | controls[0] | 0.95 | the tagger's words |
| controls | whether the questions have been validated Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. eliminates: nothing, declared three times over: 'few have been validated', 'most are predominately designed for high-income settings', and SAGE's own report says they are validated 'only in some high-income countries or not at all' · outcome: failed | controls[1] | 0.95 | the tagger's words |
| controls | whether the item pool covers the construct it is mapped onto Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. eliminates: nothing - the questions 'do not address all the determinants in the Vaccine Hesitancy Matrix', and the remedy offered is that more 'will need to be developed and validated' · outcome: failed | controls[2] | 0.95 | the tagger's words |
| controls | the two JRF indicators were pilot-tested across the Americas, Europe and East, South and Central Africa, in four languages, before being proposed Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. eliminates: single-region wording effects as an explanation of the responses - the paper says the spread 'allowed for input from a broad range of high, middle and low-income countries' · outcome: partial | controls[3] | 0.85 | the tagger's words |
| concepts | vaccine hesitancy Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: vaccine hesitancy | concepts[0] | 0.95 | the paper's words |
| concepts | delay in acceptance or refusal of vaccines Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | concepts[1] | 0.95 | the paper's words |
| concepts | refusal Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: refusal | concepts[2] | 0.95 | the paper's words |
| concepts | access issues Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: access issues | concepts[3] | 0.95 | the paper's words |
| concepts | vaccine confidence Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: vaccine confidence | concepts[4] | 0.95 | the paper's words |
| concepts | Vaccine Hesitancy Matrix Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: Vaccine Hesitancy Matrix | concepts[5] | 0.95 | the paper's words |
| concepts | JRF Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: JRF | concepts[6] | 0.95 | the paper's words |
| senses | vaccine hesitancy, AS QUOTED HERE - `refers to a delay in acceptance or refusal of vaccination despite availability of vaccination services ... time, place, and vaccines`. Two words apart from macdonald2015's own text, which says `delay` and `place and` Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | senses[0] | 0.95 | the tagger's words |
| senses | vaccine hesitancy, AS RESTATED IN THE DISCUSSION - `delay in acceptance or refusal of vaccines despite availability of vaccine services`. THIS IS THE NARROW READING macdonald2015 EXPLICITLY DECLINED, appearing in the paper that builds the instrument. Three versions of one definition, two of them in this record Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | senses[1] | 0.95 | the tagger's words |
| senses | hesitancy vs REFUSAL vs ACCESS - the three the instrument exists to separate. `Refusal is not the same as hesitancy, i.e. counting only vaccine refusers will not capture hesitancy`, and hesitancy must be assessed `as distinct from access issues`. A raw uptake number confounds all three Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | senses[2] | 0.95 | the tagger's words |
| senses | `vaccine confidence` - WHAT THE 2012 INSTRUMENT ACTUALLY MEASURED, chosen `rather than the broader issues driving vaccine hesitancy` and `in order to be in harmony with the Global Vaccine Action Plan indicators`. The 2013 revision widened it back to complacency and convenience Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | senses[3] | 0.95 | the tagger's words |
| senses | `a survey question about vaccine hesitancy` - OPERATIONALLY, whatever two keyword searches returned from 2,933 re-screened articles: `Survey` with any of accept/barrier/refus/trust/missed/delay/confidence/partial/unsure/timeliness/hesitan, or Scale/Index/measurement/instrument/Questionnaire with any of Trust/Confidence/Hesitan Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | senses[4] | 0.95 | the tagger's words |
| claim_relations | extends → macdonald2015's definition of vaccine hesitancy and its Determinants Matrix - this paper is the instrument for that definition, by the same working group, in the adjacent article of the same supplement Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | claim_relations[0] | 0.95 | the tagger's words |
| claim_relations | supports → the Global Vaccine Action Plan's Strategic Objective 2 indicators - which the 2012 pilot was shaped to match before the construct was Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | claim_relations[1] | 0.95 | the tagger's words |
| claim_relations | extends → SAGE's own final report, whose validation warning the paper quotes against its own compendium Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | claim_relations[2] | 0.95 | the tagger's words |
| concept_edges | vaccine hesitancy —operationalised-as→ delay in acceptance or refusal of vaccines Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | concept_edges[0] | 0.95 | the tagger's words |
| concept_edges | vaccine hesitancy —distinct-from→ refusal Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. Audit 2026-09-28: DOUBTFUL - read against its full span and kept, but endpoint by anaphora: 'hesitancy' = vaccine hesitancy (previous sentence). also in: vaccine hesitancy · refusal | concept_edges[1] | 0.95 | the tagger's words |
| concept_edges | vaccine hesitancy —distinct-from→ access issues Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: vaccine hesitancy · access issues | concept_edges[2] | 0.95 | the tagger's words |
| concept_edges | vaccine confidence —distinct-from→ vaccine hesitancy Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. Audit 2026-09-28: DOUBTFUL - read against its full span and kept, but the span says the pilot focused on vaccine confidence rather than the broader issues driving hesitancy; distinct-from is loose. also in: vaccine confidence · vaccine hesitancy | concept_edges[3] | 0.95 | the tagger's words |
| content_tags | one stated form of the definition speaks of vaccines and vaccine services rather than vaccination and vaccination services Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[0] | 0.95 | the tagger's words |
| content_tags | the quoted definition calls vaccine hesitancy a delay in acceptance or refusal of vaccination despite available services, complex, context specific, and influenced by complacency, convenience and confidence Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[1] | 0.95 | the tagger's words |
| content_tags | REFUSAL IS NOT HESITANCY, stated as a rule for question selection: `counting only vaccine refusers will not capture hesitancy` Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[2] | 0.95 | the tagger's words |
| content_tags | hesitancy must be assessed as distinct from access issues Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[3] | 0.95 | the tagger's words |
| content_tags | the 2012 JRF pilot focused on vaccine confidence rather than broader hesitancy, to match the Global Vaccine Action Plan indicators Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[4] | 0.95 | the tagger's words |
| content_tags | the 2012 JRF pilot response rate was 14% - 13 of 94 countries - and the paper calls it sub-optimal Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[5] | 0.95 | the tagger's words |
| content_tags | the item pool came from two keyword searches over 2,933 re-screened articles Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[6] | 0.95 | the tagger's words |
| content_tags | the compendium mixes items from previously validated questionnaires (high-income countries only), items from experts, and newly proposed ones Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[7] | 0.95 | the tagger's words |
| content_tags | the questions `do not address all the determinants in the Vaccine Hesitancy Matrix` and `few have been validated` Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[8] | 0.95 | the tagger's words |
| content_tags | SAGE's own final report is quoted warning that the compendium has been `assessed and validated only in some high-income countries or not at all` Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[9] | 0.95 | the tagger's words |
| content_tags | the construct is declared unstable in time: `a survey which reveals little hesitancy this year may have a different result next year` Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[10] | 0.95 | the tagger's words |
| content_tags | and SAGE calls for sociologists, psychologists, anthropologists, social marketers and communication experts - a MULTI-DISCIPLINARY approach to a single construct Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[11] | 0.95 | the tagger's words |
| content_tags | a delay in acceptance or refusal of vaccination despite availability of vaccination services; complex and context specific, varying across time, place, and vaccines Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: vaccine hesitancy | content_tags.definitions[0] | 0.95 | the tagger's words |
| content_tags | delay in acceptance or refusal of VACCINES despite availability of VACCINE SERVICES - the narrower form, in the same paper Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: Vaccine hesitancy | content_tags.definitions[1] | 0.95 | the tagger's words |
| content_tags | articles re-screened to harvest candidate survey items Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.quantities[0] | 0.95 | the tagger's words |
| content_tags | percent response to the first JRF pilot - 13 of 94 countries Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.quantities[1] | 0.95 | the tagger's words |
| content_tags | vaccine confidence Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: vaccine confidence | content_tags.variables[0] | 0.95 | the tagger's words |
Tags that could not be placed in the text:
What was deliberately not tagged, and why, is recorded per paper by the tagger. Where a paper has no such record, this page says so rather than implying that nothing was declined.