<?xml version="1.0" encoding="UTF-8"?>
<TEI xmlns="http://www.tei-c.org/ns/1.0" xml:lang="en">
  <teiHeader>
    <fileDesc>
      <titleStmt>
        <title>The Enemy from Within: A Study of Political Delegitimization Discourse in Israeli Political Speech</title>
        <author>Naama Rivlin-Angert</author>
        <author>Guy Mor-Lan</author>
      </titleStmt>
      <publicationStmt>
        <p>Tag layer of the DHSS Meta-Tagging Project. The article text is reproduced from the
           staged copy named in sourceDesc and is not altered; the tags are held separately in
           standOff so that overlapping and nested spans are preserved.</p>
      </publicationStmt>
      <sourceDesc>
        <bibl>
          <title>The Enemy from Within: A Study of Political Delegitimization Discourse in Israeli Political Speech</title>
          <date>2025</date>
          <publisher>EMNLP 2025</publisher>
          
          
          <idno type="record">rivlinangert2025-enemy-within</idno>
          <note type="staged-file">rivlinangert2025-enemy-within.txt, the project's staged copy</note>
          <note type="text-sha1">48ff038ac6991c6a765385adbd2a8b1063e3c202</note>
          <note type="rights">CC-BY-4.0</note>
        </bibl>
      </sourceDesc>
    </fileDesc>
    <profileDesc>
      <textClass><keywords><term>political-science</term></keywords></textClass>
      <particDesc>
        <person xml:id="paper"><p>the paper's own words</p></person>
        <person xml:id="tagger"><p>the tag layer; a sentence written by the tagger about the
          paper, always anchored to a quotation but not itself a quotation</p></person>
      </particDesc>
    </profileDesc>
    <revisionDesc>
      <change when="2026-10-06"
              who="build_paper_edition.py">0 spans located by searching the stored text for the quote's exact words, allowing any whitespace between them</change>
    </revisionDesc>
  </teiHeader>
  <standOff>
    <spanGrp type="tags">
      <span xml:id="t0" type="claim_type" ana="#claim_type" resp="#paper">
        <label>method</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t1" type="phenomenon" ana="#phenomenon" resp="#paper">
        <label>political delegitimization discourse</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t2" type="method" ana="#method" resp="#paper">
        <label>system-or-tool-building</label>
        <term>system-or-tool-building</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t3" type="mechanisms" ana="#mechanisms[0]" resp="#tagger" cert="0.9">
        <label>mechanisms</label>
        <term>a two-stage pipeline: a binary classifier first decides whether a sentence carries PDD at all, and only sentences it marks positive go on to be classified for properties and target spans</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t4" type="mechanisms" ana="#mechanisms[1]" resp="#tagger" cert="0.9">
        <label>mechanisms</label>
        <term>the category is drawn by what the utterance DOES to the target&#x27;s standing rather than by whether it is rude, and the paper says this is why classifiers built on surface hostility miss the subtle cases</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t5" type="mechanisms" ana="#mechanisms[2]" resp="#tagger" cert="0.9">
        <label>mechanisms</label>
        <term>the boundary against policy criticism is enforced by a worked NEGATIVE example rather than by a rule</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t6" type="mechanisms" ana="#mechanisms[3]" resp="#tagger" cert="0.9">
        <label>mechanisms</label>
        <term>every proportion is computed by aggregating at the SPEAKER level first, so that prolific politicians cannot dominate the rate</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t7" type="mechanisms" ana="#mechanisms[4]" resp="#tagger" cert="0.9">
        <label>mechanisms</label>
        <term>distinctive targets per political bloc are identified with a weighted log-odds method rather than by raw frequency</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t8" type="limitations" ana="#limitations[0]" resp="#tagger">
        <label>The study&#x27;s scope and transferability are limited.</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t9" type="limitations" ana="#limitations[1]" resp="#tagger">
        <label>Findings from the Hebrew-language, Israeli case may not generalize to other languages or political systems.</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t10" type="limitations" ana="#limitations[2]" resp="#tagger">
        <label>The social media analysis covers only Facebook posts from 2018-2021, excluding other platforms and later periods.</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t11" type="limitations" ana="#limitations[3]" resp="#tagger">
        <label>Porting the approach to other languages and political contexts is expected to be difficult because delegitimization is shaped by local dynamics.</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t12" type="limitations" ana="#limitations[4]" resp="#tagger" cert="1.0">
        <label>The category is defined by excluding policy criticism, a line a coder must draw in each sentence.</label>
        <note>what this limits: any count of delegitimizing speech from this corpus: a sentence counts only if the hostile characterization is Quotation withheld, which is a judgement made per sentence</note>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t13" type="limitations" ana="#limitations[5]" resp="#tagger" cert="1.0">
        <label>Reliability was established on a 170-sentence sample by coders who include the study&#x27;s lead author.</label>
        <note>what this limits: the reliability of the labels underlying these results: annotation was by three human annotators including the lead author, with agreement measured on a sample of 170 sentences</note>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t14" type="limitations" ana="#limitations[6]" resp="#tagger" cert="1.0">
        <label>Only a sixth of the labelled corpus carries the finer annotations the characterisation rests on.</label>
        <note>what this limits: claims here about intensity, incivility, target type or affective framing: those annotations exist for 642 instances, against 1,812 sentences exhibiting the phenomenon in a corpus of 10,410</note>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t15" type="limitations" ana="#limitations[7]" resp="#tagger" cert="1.0">
        <label>The category is proposed by this paper rather than inherited from the literature.</label>
        <note>what this limits: treating PDD as an established construct: it is proposed in this paper as a distinct analytical category alongside the pipeline built to detect it</note>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t16" type="transfers" ana="#transfers[0]" resp="#tagger" cert="0.8">
        <label>transformer encoder models (multilingual mBERT, and the Hebrew-targeted AlephBERT and HeRO) and LLM decoders, applied to detect political delegitimization discourse in Knesset and social media text</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t17" type="transfers" ana="#transfers[1]" resp="#tagger" cert="0.75">
        <label>the weighted log-odds method for identifying tokens most strongly associated with a group, applied to political blocs</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t18" type="controls" ana="#controls[0]" resp="#tagger" cert="0.85">
        <label>the annotated dataset split 70 per cent train, 15 per cent validation, 15 per cent test</label>
        <note>eliminates: reporting classifier performance on data used to fit or to select it - the three-way split separates fitting, model choice and reporting · outcome (stated by the tagger, no quotation): held</note>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t19" type="concepts" ana="#concepts[5]" resp="#paper">
        <label>Political Delegitimization Discourse</label>
        <term>Political Delegitimization Discourse</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t20" type="concepts" ana="#concepts[6]" resp="#paper">
        <label>PDD</label>
        <term>PDD</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t21" type="concepts" ana="#concepts[7]" resp="#paper">
        <label>policy critique</label>
        <term>policy critique</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t22" type="concepts" ana="#concepts[8]" resp="#paper">
        <label>incivility</label>
        <term>incivility</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t23" type="concepts" ana="#concepts[9]" resp="#paper">
        <label>annotation scheme</label>
        <term>annotation scheme</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t24" type="senses" ana="#senses[0]" resp="#tagger" cert="1.0">
        <label>PDD - A STIPULATED CATEGORY WHOSE BOUNDARY IS SYMBOL VERSUS POLICY: hostility toward a political actor counts only when it is not grounded in policy critique, so the same anger about the same target falls inside or outside the category depending on what the coder judges it to be aimed at</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t25" type="senses" ana="#senses[1]" resp="#tagger" cert="1.0">
        <label>the boundary, SHOWN RATHER THAN STATED: the paper prints a sentence calling a budget an example of negligence and promiscuous conduct endangering the economy and society, and records that it is NOT annotated as PDD - a published negative case, which is rarer in this corpus than a definition</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t26" type="senses" ana="#senses[2]" resp="#tagger" cert="1.0">
        <label>the conceptual definition BEHIND the annotation scheme: discourse aimed at discrediting political groups or actors by attacking their symbolic and affective dimensions - the scheme is built on that phrase, and every count in the paper inherits it</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t27" type="claim_relations" ana="#claim_relations[0]" resp="#tagger">
        <label>builds-on → Rivlin-Angert (2025), on delegitimization of political identities</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t28" type="claim_relations" ana="#claim_relations[1]" resp="#tagger">
        <label>builds-on → Mor-Lan et al. (2024), IsraParlTweet dataset of Knesset speeches</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t29" type="claim_relations" ana="#claim_relations[2]" resp="#tagger">
        <label>builds-on → Monroe et al. (2008), weighted log odds method</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t30" type="claim_relations" ana="#claim_relations[3]" resp="#tagger">
        <label>extends → existing NLP tasks: toxicity detection, stance detection, targeted sentiment analysis</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t31" type="concept_edges" ana="#concept_edges[0]" resp="#tagger">
        <label>PDD —same-as→ Political Delegitimization Discourse</label>
        <term>PDD</term>
        <term>Political Delegitimization Discourse</term>
        <note>strength of the relation: 1</note>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t32" type="concept_edges" ana="#concept_edges[1]" resp="#tagger">
        <label>PDD —distinct-from→ policy critique</label>
        <term>PDD</term>
        <term>policy critique</term>
        <note>strength of the relation: 1</note>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t33" type="content_tags" ana="#content_tags.findings[0]" resp="#tagger">
        <label>Delegitimization intensity was rated on a three-point scale.</label>
        <note>about this quote: QUOTE RECOVERED FROM THE PAPER&#x27;S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file&#x27;s own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted.</note>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t34" type="content_tags" ana="#content_tags.findings[1]" resp="#tagger">
        <label>Early computational approaches used supervised classifiers to detect abusive language aimed at politicians.</label>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t35" type="content_tags" ana="#content_tags.statistics[0]" resp="#tagger" cert="0.9">
        <label>inter-coder reliability on a 170-sentence sample: average correlation 0.91 and average Cohen&#x27;s Kappa 0.82, called substantial agreement</label>
        <term>inter-coder reliability on a 170-sentence sample: average correlation 0.91 and average Cohen&#x27;s Kappa 0.82, called substantial agreement</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t36" type="content_tags" ana="#content_tags.statistics[1]" resp="#tagger" cert="0.9">
        <label>the rise in parliamentary PDD: mean share 6.6% to 9.8%, reported with t = -105.24 and p &lt; 0.01 alongside |d| = 0.13</label>
        <term>the rise in parliamentary PDD: mean share 6.6% to 9.8%, reported with t = -105.24 and p &lt; 0.01 alongside |d| = 0.13</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t37" type="content_tags" ana="#content_tags.statistics[2]" resp="#tagger" cert="0.9">
        <label>the gender difference: 0.066 against 0.055, called modest in the same sentence as significant, t = 2.613, p = 0.010, |d| = 0.268</label>
        <term>the gender difference: 0.066 against 0.055, called modest in the same sentence as significant, t = 2.613, p = 0.010, |d| = 0.268</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
      <span xml:id="t38" type="content_tags" ana="#content_tags.statistics[3]" resp="#tagger" cert="0.9">
        <label>the corpus: 10,410 annotated sentences, 1,812 PDD-positive at 17.4%, and 642 carrying the second-stage annotations</label>
        <term>the corpus: 10,410 annotated sentences, 1,812 PDD-positive at 17.4%, and 642 carrying the second-stage annotations</term>
        <note type="quotation-withheld">Quotation withheld because this record is not cleared for redistribution.</note>
      </span>
    </spanGrp>
  </standOff>
  <text>
    <body>
      <p><note type="rights">The full text of this article is not redistributable, so it is
      not included here. The evidence sentences are withheld with it; the tag layer and its
      grounding status remain. The article itself is at .</note></p>
    </body>
  </text>
</TEI>
