phenomenon · claim-type · cross-domain-transfer · mechanism · claim-relation · replication-status · limitation — grounded in the full text| phenomenon | critical appraisal of evidence in medical education— “This review confirms that critical appraisal in medical education must extend beyond rigid methodological hierarchies.” | |
| claim-type | method— “Drawing on the synthesized literature, an integrative appraisal matrix was developed.” | |
| method — evidence | — “A systematic review was conducted in accordance with PRISMA 2020 guidelines (7).” | |
| transfer | from evidence-based medicine / clinical research: The review's whole object is the import of evidence-based medicine's appraisal principles and evidence hierarchies into medical education, an import it judges conceptually and methodologically problematic and then reworks into an education-specific matrix.— “While the principles of evidence-based medicine have substantially shaped clinical decision-making, their direct transfer to educational contexts has proven conceptually methodologically challenging.” | transfers[0] |
| mechanism | Educational interventions sit inside complex social systems, which blocks causal attribution and so makes biomedical evidence hierarchies inapplicable.— “Educational interventions are often embedded within complex social systems, making causal attribution difficult and limiting the applicability of traditional evidence hierarchies (6).” | mechanisms[0] |
| mechanism | Absent an explicit theoretical frame, a study stays descriptive, which drains its explanatory power and stops findings accumulating across the field.— “Without theoretical grounding, studies often remain descriptive, limiting their explanatory power and their capacity to contribute cumulatively to the field.” | mechanisms[1] |
| control | editorials without methodological content and purely clinical studies excluded before appraisal — held — rules out an appraisal of evidence quality carried out on documents that make no methodological claim— “Editorials without methodological content and purely clinical studies were excluded.” | controls[0] |
| outcome (stated by the tagger, no quotation) | control — held | controls[0] |
| replication | untested | |
| limitation | Restricted to English-language publications and excluded grey literature.— “This review was limited to English-language publications and did not include grey literature.” | limitations[0] |
| limitation | The narrative synthesis approach may introduce interpretive bias.— “Narrative synthesis may also introduce interpretive bias.” | limitations[1] |
finding · quantity · variable · definition · key-term — grounded in the full text| finding | Of 1,246 records retrieved by the database search, 84 studies met the inclusion criteria.— “The database search yielded 1,246 records. After removal of duplicates and screening, 84 studies met the inclusion criteria.” | content_tags.findings[0] |
| finding | Evidence in medical education research falls into four types: quantitative, qualitative, mixed-methods, and design-based research.— “categorized into quantitative, qualitative, mixed-methods, and design-based research.” | content_tags.findings[1] |
| finding | Biomedical evidence hierarchies imported into medical education failed to capture educational relevance and contextual complexity.— “Traditional biomedical hierarchies were insufficient to capture educational relevance and contextual complexity.” | content_tags.findings[2] |
| finding | BEME, MERSQI, CASP and realist review frameworks were the appraisal tools most often cited, but they were applied inconsistently across the included studies.— “Appraisal tools such as BEME, MERSQI, CASP, and realist review frameworks were commonly cited, yet inconsistently applied.” | content_tags.findings[3] |
| finding | Randomised controlled trials were frequently impractical or educationally reductive in education settings, while qualitative and theory-driven studies were undervalued despite being methodologically rigorous.— “Randomized controlled trials, while methodologically robust, were often impractical or educationally reductive (6,12). Conversely, qualitative and theorydriven research, despite methodological rigor, was frequently undervalued (19,25).” | content_tags.findings[4] |
| finding | Theory is underused throughout the reviewed medical education research and appraisal literature. | content_tags.findings[5] |
| finding | The review develops an integrative appraisal matrix from the synthesised literature. | content_tags.findings[6] |
| finding | The proposed matrix scores studies on six domains - relevance, methodological rigor, theoretical grounding, outcomes meaningfulness, context, and impact - instead of reducing quality to one number. | content_tags.findings[7] |
| quantity | 1,246 — records returned by the database search before de-duplication and screening Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.quantities[0] |
| quantity | 84 — studies that met the inclusion criteria and were synthesised Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.quantities[1] |
| quantity | 2000 and 2024 — publication window for eligible studies in the four databases searched Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.quantities[2] |
| definition | transferability Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.definitions[0] |
| definition | context Quotation withheld — this paper is not ours to reproduce, and the page has already quoted as much of it as the rights layer allows. The tag, its field and its confidence stand; the sentence is at the publisher. | content_tags.definitions[1] |
| evidence status note | definition — THE QUOTE STOPS WHERE THE EXTRACTED TEXT GOES OUT OF ORDER: the words that follow it in the extraction ('review educational reinforces that generalizability …') belong to another line of the page, so the sentence cannot be completed from this copy. | content_tags.definitions[1] |
When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote for that row; on this page it is withheld with the article, and the article is at its publisher. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.
Tag layer © the Meta-Tagging Project, CC BY 4.0. The paper text is © its authors/publisher
and is linked, not reproduced. Excerpts shown are short quotations for identification and verification.
· back to index
· concepts · authors
· עברית
© 2026 Shir Sivroni · ORCID 0009-0000-2597-2824