(cid:NN). The PDF this text was extracted from encodes 2 characters in a way that names no letter, so the extractor could not say what they were. The quotes keep them because a quote is reproduced exactly or it proves nothing — the marks are the source’s, not the tagging’s.standOff, and the article is at its publisher via the link below. When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote for that row; on this page it is withheld with the article, and the article is at its publisher. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.| relation to other work | claim_relations | how this paper stands to another: agrees, contradicts, extends, qualifies |
| claim type | claim_type | the shape of the claim: existence, mechanism, method, critique, prediction, null |
| concept edge | concept_edges | an asserted relation between two concepts, with the sentence asserting it |
| concept | concepts | an idea the paper works with, quoted where the paper uses it |
| content tag | content_tags | a finding, definition, quantity, statistic or variable named in the paper |
| limitation | limitations | what the paper says its evidence cannot support |
| mechanism | mechanisms | how the reported effect is said to come about |
| method | method | how the paper produced its evidence |
| phenomenon | phenomenon | the effect or regularity under study |
| sense | senses | a distinct use of a term, quoted where the paper fixes it |
| transfer | transfers | a method or concept carried in from another field |
Relations on this page carry a quotation for the claim. Where a relation was separately evidenced — and so tested against the vocabulary for its type — the row says so; none of 2 relations here carry that mark. The rest are the tagger’s reading of the sentence quoted beside them.
This record holds no controls. A layer is empty when the tagger recorded nothing in it — which is not the same as the paper having nothing to record.
| facet | tag | field | conf. | whose words |
|---|---|---|---|---|
| claim_type | method Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | claim_type | the paper's words | |
| phenomenon | machine learning for combinatorial optimization Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | phenomenon | the paper's words | |
| method | review Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: review | method | the paper's words | |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | mechanisms[0] | 0.95 | the tagger's words |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. about this quote: RE-SLICED. The acceptance footnote and licence notice are spliced INTO this sentence - "to use mathematics and computer science * Accepted to the European Journal of Operations Research. c(cid:13)2020. Licensed under the Creative Commons cbnd 1 to assist military planners" - so it cannot be quoted whole. The naming is at its head. 'c(cid:13)' is a copyright symbol that failed to map. | mechanisms[1] | 0.85 | the tagger's words |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | mechanisms[2] | 0.95 | the tagger's words |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | mechanisms[3] | 0.95 | the tagger's words |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | mechanisms[4] | 0.85 | the tagger's words |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | mechanisms[5] | 0.95 | the tagger's words |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. about this quote: RE-SLICED, AND MY OWN CUT-WORD GUARD IS WHAT CAUGHT IT. My first end key was "...even without e" - which is where a 240-character DEBUG PRINT had truncated the sentence while I was searching the file. I used the output of my own truncated display as a key. The guard refused it, and the real text is "even without explicit learning components". Slice from the FILE, never from a print of the file. | mechanisms[6] | 0.85 | the tagger's words |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | mechanisms[7] | 0.95 | the tagger's words |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | mechanisms[8] | 0.95 | the tagger's words |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. about this quote: EXTENDED: the first cut stopped before "and learn one branching policy per city?", which the tag depends on - the question mark carries the whole force of the point. | mechanisms[9] | 0.85 | the tagger's words |
| mechanisms | mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | mechanisms[10] | 0.95 | the tagger's words |
| limitations | in imitation-learning settings, performance is bounded by the (possibly suboptimal) expert Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: every imitation-learning result: Quotation withheld - it cannot exceed what it imitates | limitations[0] | the tagger's words | |
| limitations | learned algorithms may not generalize to unseen problem instances Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: any generalisation claim: the learned algorithm Quotation withheld | limitations[1] | the tagger's words | |
| limitations | The literature surveyed is early-stage rather than mature, so the survey reports directions rather than settled algorithms. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: the standing of the survey's conclusions: THE LITERATURE WE SURVEY IS EXPLORATORY, I.E., WE AIM AT HIGHLIGHTING PROMISING RESEARCH DIRECTIONS ... INSTEAD OF RE[porting settled results] | limitations[2] | the tagger's words | |
| limitations | Unsupervised learning is excluded from the survey. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: the coverage of the survey: unsupervised learning is excluded | limitations[3] | the tagger's words | |
| limitations | The treatment of imitation learning is a simplification of the ML literature. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: the imitation-learning material as a guide to that literature: THE PART OF IMITATION LEARNING PRESENTED HERE IS LIMITED COMPARED TO THE CURRENT LITERATURE IN ML | limitations[4] | the tagger's words | |
| limitations | Choosing which learning algorithm will perform best is outside the scope of the proposed methodology. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: any use of the methodology to choose between algorithms: IDENTIFYING WHICH ALGORITHM WILL PERFORM BEST IS AN OPEN RESEARCH QUESTION UNLIKELY TO HAVE A SIMPLE ANSWER, AND IS OUTSIDE OF THE SCOPE OF THE METHODOLOGY PRESENTED HERE | limitations[5] | the tagger's words | |
| limitations | The expert decisions the learned models are fitted to are stated to be, in part, mathematically not well defined. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: a learned replacement for a solver heuristic: the decisions in question are ones that are either too expensive to compute or mathematically not well defined, so for some of them there is no formal target the model could be right or wrong about | limitations[6] | 1.0 | the tagger's words |
| limitations | The distribution the method is supposed to learn cannot be characterised, so a finite set of collected instances silently becomes the definition of the problem class. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: a claim that a learned CO algorithm solves a problem class: the true distribution is unknown and cannot be characterised explicitly, so what is learned is whatever a finite collected set - for instance a company's historical instances - happens to contain | limitations[7] | 1.0 | the tagger's words |
| limitations | The quantity that defines success is stated to be inaccessible, and every reported figure is an estimate of it on held-out data. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: any reported generalization error: the objective it estimates remains inaccessible, so the number is the model's performance on a particular held-out set and not the property itself | limitations[8] | 1.0 | the tagger's words |
| transfers | using machine learning to learn heuristics for combinatorial optimization problems Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | transfers[0] | the tagger's words | |
| concepts | combinatorial optimization Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: combinatorial optimization | concepts[0] | the paper's words | |
| concepts | heuristic Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: heuristic | concepts[5] | the paper's words | |
| concepts | generalization error Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: generalization error | concepts[6] | the paper's words | |
| concepts | overfitting Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: overfitting | concepts[7] | the paper's words | |
| concepts | capacity Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: capacity | concepts[8] | the paper's words | |
| concepts | test dataset Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: test dataset | concepts[9] | the paper's words | |
| senses | generalizing - THE INFORMAL SENSE: performance stays similar between the instances used for learning and unseen ones, which is how the word is used throughout the survey Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | senses[0] | 1.0 | the tagger's words |
| senses | generalize - THE FORMAL SENSE, AGAINST SOMETHING INACCESSIBLE: low values of the empirical objective translating into low values of the true one, where the true one cannot be computed and is estimated on a test set instead Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | senses[1] | 1.0 | the tagger's words |
| senses | the distribution of problems - AS WHATEVER WAS COLLECTED: unknown, not explicitly characterisable, and represented in practice by a finite set of historical instances, which is what the learned algorithm actually fits Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | senses[2] | 1.0 | the tagger's words |
| claim_relations | builds-on → machine learning (from CS/AI) Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | claim_relations[0] | the tagger's words | |
| concept_edges | capacity —causes→ overfitting Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. strength of the relation: 1 also in: capacity · overfitting | concept_edges[0] | the tagger's words | |
| concept_edges | generalization error —operationalised-as→ test dataset Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. strength of the relation: 1 also in: generalization error · test dataset | concept_edges[1] | the tagger's words | |
| content_tags | millions — scale CO solvers reach in practice Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.quantities[0] | the tagger's words | |
| content_tags | 2 — ways ML can improve a CO algorithm Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.quantities[1] | the tagger's words | |
| content_tags | 2 — survey axes the paper derives Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.quantities[2] | the tagger's words | |
| content_tags | ML is a natural candidate to replace hand-crafted heuristic decisions Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[0] | the tagger's words | |
| content_tags | adding learning need not compromise overall theoretical guarantees Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. about this quote: QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted. | content_tags.findings[1] | the tagger's words | |
| content_tags | the surveyed CO problems are NP-hard Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[2] | the tagger's words | |
| content_tags | generic optimization problems can be treated as data points Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. | content_tags.findings[3] | the tagger's words | |
| content_tags | decision variables Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: decision variables | content_tags.variables[0] | the tagger's words | |
| content_tags | distribution of problem instances Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: distribution of problem instances | content_tags.variables[1] | the tagger's words | |
| content_tags | policy Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: policy | content_tags.variables[2] | the tagger's words | |
| content_tags | combinatorial optimization (CO) Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. about this quote: QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted. also in: combinatorial optimization (CO) | content_tags.definitions[0] | the tagger's words | |
| content_tags | traveling salesman problem (TSP) Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: traveling salesman problem (TSP) | content_tags.definitions[1] | the tagger's words | |
| content_tags | generalizing Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: generalizing | content_tags.definitions[2] | the tagger's words | |
| content_tags | operations research Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: operations research | content_tags.definitions[3] | the tagger's words |
Tags that could not be placed in the text:
What was deliberately not tagged, and why, is recorded per paper by the tagger. Where a paper has no such record, this page says so rather than implying that nothing was declined.