Estimation and Inference of Heterogeneous Treatment Effects using Random Forests

Stefan Wager, Susan Athey · JASA / arXiv · 2018 · statistics · 10.1080/01621459.2017.1319839 · record wager2018-causal-forests
tag layer · index · concepts · authors · עברית

Where this record's text came from. faceted 2026-08 by reading the locally held text (pdftext); every evidence string verified as an exact substring of that text before merging. method: none of the enumerated method values fits a theorem-and-proof statistics paper, so 'mathematical-proof' is used; the paper does also contain a simulation section, verbatim: 'Finally, we compare the performance of the causal forest algorithm against classical knearest neighbor matching using simulations, finding that the causal forest dominates in Quotation withheld.' (the 'knearest' typo is in the extracted text). The extracted text ends mid-sentence inside the Discussion, so there is no reference list and no closing remarks; figures are rendered as long runs of bullet characters. Replication status is 'untested' because the paper reports only its own simulations and no external replication. 2026-08-14 and 2026-08-15 schema-0.3 passes: every quote verified as an exact substring of the staged text and anchored at merge time; concept terms verified present; every edge endpoint an existing node.

How to read this page. The article itself is not reproduced here — this paper is not cleared for redistribution, so what follows is the tag layer alone. The evidence sentences are withheld with the article. The table at the foot lists every tag the record carries; each row names the facet it belongs to, and the whose words column says whether the tag records the paper's own wording or the tagger's sentence about the paper. Every tag links to each other paper in the corpus carrying it. The machine-readable edition of the same thing is the TEI file beside this one, where the tags live in standOff, and the article is at its publisher via the link below. When we have changed our mind. Some entries in the table begin with a word in capitals and the reason for it. EVIDENCE CORRECTED — the finding still stands, but we had quoted the wrong sentence from the paper, and the quotation has been replaced with the right one. RETRACTED — the entry itself was wrong; it stays on the page, marked, with the reason, rather than being deleted. WITHDRAWN AND REPLACED — the entry was wrong, and a corrected version of it appears in the entries below. Each mark carries its own reason, in brackets, because the reasons differ from one entry to the next. An entry we have WITHDRAWN is removed from this page and kept in the record, with its reason. A line reading Audit and a date is a later re-reading of the entry against its whole sentence: DOUBTFUL means it was kept, and the reason says what is loose about it. Quotation marks inside the tagger's sentence. Where a tag is the tagger's own sentence, a phrase in quotation marks inside it is borrowed from the paper — the tagger's wording around it is not. The paper's own sentence is the evidence quote for that row; on this page it is withheld with the article, and the article is at its publisher. Nothing inside quotation marks anywhere on this page is ours: if it is quoted, it is the paper's. Whose words a concept carries. A concept entry records a term the paper itself uses, so the term, the sense given for it, and its evidence are the paper's own words, quoted where the paper fixes them. This is the opposite of a sense entry in the tag table, which is the tagger's sentence about how the paper uses a term. Where a concept entry could not be grounded in the paper's words, the entry says so on its own row.

Other fields define these differently the same word, defined another way in another discipline
machine learning 14 fields · sample-size 5 fields · bootstrap 2 fields · confidence-interval 2 fields · confidence intervals 2 fields · random forest 2 fields

Tags on this paper

Every tag the record carries, each linking to every other paper in the corpus that carries it. A tag appears here whether or not its words occur in the article — the spans below are only the ones a sentence in this paper licenses. Of the 12 concept tags on this paper, 9 are grounded in a quoted sentence. 1 carry the tagger's gloss of what the term means in this paper, which is not something the article can license.

causal inference treatment effect random forest machine learning unconfoundedness honesty causal forest double-sample trees subsample size confidence intervals test set double-sample tree treating a random forest as an adaptive nearest-neighbor estimator yields consistent, asymptotically Gaussian treatment-effect estimates, enabling confidence intervals heterogeneous treatment effects random forests potential outcomes asymptotic normality nonparametric covariates consistency potential outcomes framework with unconfoundedness number of covariates honest trees ANOVA Bayesian bootstrap confidence-interval mean average of sample-size sample size mathematical-proof

Legend

relation to other work	`claim_relations`	how this paper stands to another: agrees, contradicts, extends, qualifies
claim type	`claim_type`	the shape of the claim: existence, mechanism, method, critique, prediction, null
concept edge	`concept_edges`	an asserted relation between two concepts, with the sentence asserting it
concept	`concepts`	an idea the paper works with, quoted where the paper uses it
content tag	`content_tags`	a finding, definition, quantity, statistic or variable named in the paper
limitation	`limitations`	what the paper says its evidence cannot support
mechanism	`mechanisms`	how the reported effect is said to come about
method	`method`	how the paper produced its evidence
phenomenon	`phenomenon`	the effect or regularity under study
sense	`senses`	a distinct use of a term, quoted where the paper fixes it
transfer	`transfers`	a method or concept carried in from another field

The paper

The full text is not reproduced here. This article is not cleared for redistribution, so the page carries the tag layer only. Its evidence sentences are withheld; the grounding status remains with each tag, and the article itself is at https://doi.org/10.1080/01621459.2017.1319839. The reading view exists for the papers whose licence permits it.

Every tag on this page

claim_relations 5 · claim_type 1 · concept_edges 2 · concepts 9 · content_tags 20 · limitations 7 · mechanisms 1 · method 1 · phenomenon 1 · senses 7 · transfers 1

Relations on this page carry a quotation for the claim. Where a relation was separately evidenced — and so tested against the vocabulary for its type — the row says so; none of 2 relations here carry that mark. The rest are the tagger’s reading of the sentence quoted beside them.

This record holds no controls. A layer is empty when the tagger recorded nothing in it — which is not the same as the paper having nothing to record.

facet	tag	field	conf.	whose words
claim_type	method Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`claim_type`		the paper's words
phenomenon	heterogeneous treatment effect estimation Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`phenomenon`		the paper's words
method	mathematical-proof Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: mathematical-proof	`method`		the paper's words
mechanisms	mechanisms Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: treating a random forest as an adaptive nearest-neighbor estimator yields consistent, asymptotically Gaussian treatment-effect estimates, enabling confidence intervals	`mechanisms[0]`		the tagger's words
limitations	results require the unconfoundedness assumption Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: every causal estimate: the results require the POTENTIAL OUTCOMES FRAMEWORK WITH UNCONFOUNDEDNESS	`limitations[0]`		the tagger's words
limitations	The choice between double-sample forests and propensity forests was made by hand for each simulation setting rather than automatically. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: the simulation comparison specifically: WE MANUALLY CHOSE WHETHER TO USE DOUBLE-SAMPLE FORESTS OR PROPENSITY FORESTS, DEPENDING ON WHICH PROCEDURE SEEMED MORE APPROPRIATE	`limitations[1]`		the tagger's words
limitations	The asymptotic normality proof does not cover classification forests built by voting. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: the asymptotic normality result: EXTENDING OUR RESULTS TO VOTING TREES IS LEFT AS FURTHER WORK	`limitations[2]`		the tagger's words
limitations	The theory is not established for high-dimensional settings where variable selection matters. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: the asymptotic theory in the regime most applications live in: WE LEAVE A STUDY OF ASYMPTOTIC NORMALITY OF RANDOM FORESTS IN HIGH DIMENSIONS TO FUTURE WORK	`limitations[3]`		the tagger's words
limitations	Residual bias degrades confidence-interval coverage, which the authors flag as the immediate open problem. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: the confidence intervals as reported: AN IMMEDIATE CHALLENGE IS TO CONTROL THE BIAS OF CAUSAL FORESTS TO ACHIEVE BETTER COVERAGE	`limitations[4]`		the tagger's words
limitations	Empirically, nominal coverage of the intervals holds only up to moderate dimension. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. what this limits: any use of the intervals above ten covariates: OUR METHOD ACHIEVES NOMINAL COVERAGE UP TO d = 10, AFTER WHICH THE PERFORMANCE OF THE CONFIDENCE INTERVALS STARTS TO DECAY	`limitations[5]`		the tagger's words
limitations	Two asymptotic-normality results for random forests can look qualitatively the same and differ on whether the subsample grows fast enough for the squared bias to vanish faster than the variance. When it does not, the Gaussian limit is real and the confidence intervals built from it do not cover. A reader taking 'asymptotically normal' as the licence for an interval has no way to see this from the claim alone. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`limitations[6]`	0.9	the tagger's words
transfers	extending Breiman random forests to estimate heterogeneous treatment effects with valid statistical inference Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`transfers[0]`		the tagger's words
concepts	treatment effect Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: treatment effect	`concepts[1]`		the paper's words
concepts	unconfoundedness Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: unconfoundedness	`concepts[4]`		the paper's words
concepts	honesty Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: honesty	`concepts[5]`		the paper's words
concepts	causal forest Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: causal forest	`concepts[6]`		the paper's words
concepts	double-sample trees Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: double-sample trees	`concepts[7]`	0.95	the paper's words
concepts	subsample size Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: subsample size	`concepts[8]`	0.9	the paper's words
concepts	confidence intervals Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: confidence intervals	`concepts[9]`	0.95	the paper's words
concepts	test set Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: test set	`concepts[10]`	0.95	the paper's words
concepts	double-sample tree Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: double-sample tree	`concepts[11]`	0.95	the paper's words
senses	unconfoundedness - the assumption that makes nearby observations behave as if they came from a randomized experiment, which is what licenses matching Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`senses[0]`	1.0	the tagger's words
senses	honesty - a condition the authors name and impose: the tree is grown on one subsample and its leaf predictions are estimated on a different one Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`senses[1]`	1.0	the tagger's words
senses	treatment effect - a quantity not estimable from the observed data at all without further restrictions on the data generating distribution Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`senses[2]`	1.0	the tagger's words
senses	evaluation - FOR A CAUSAL ESTIMAND THE STANDARD MACHINE-LEARNING SENSE IS UNAVAILABLE: only one potential outcome per unit is ever observed, so 'direct test-set evaluation is in general impossible' and asymptotic theory does the work that held-out prediction error does elsewhere Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`senses[3]`	0.95	the tagger's words
senses	sample splitting - AS COSTED HERE: the usual objection is that it wastes half the training data, and the answer is that the waste is per TREE and recovered across the ENSEMBLE, since the I/J split is re-randomised over each subsample so every point serves both roles in some tree Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`senses[4]`	0.9	the tagger's words
senses	'honesty' - A MORAL WORD GIVEN A BICONDITIONAL DEFINITION, AND THE DEFINITION IS A PROHIBITION ON DOUBLE USE. 'A tree is honest if, for each training example i, it only uses the response Yi to estimate the within-leaf treatment effect τ ... or to decide where to place the splits, but not both.' Nothing about the definition is moral - it forbids using one observation twice for two purposes. The name imports an intuition (a tree that does not cheat) that the formal content neither needs nor supports, and it travels: a reader meeting 'honest trees' in a later paper will reconstruct the intuition, not the disjunction. This record is the second half of the typology's mechanism 25 - 'athey2016' -> 'wager2018' tightening this very term. STAGED-TEXT NOTE: LaTeX-adjacency fusion in the staged text, declared rather than hidden: 'responseYi' is 'response Y_i' and 'effectτ' is 'effect τ', the space lost where prose meets a math symbol. The span is kept because it is the paper's ONLY statement of the definition and the fusion is legible; re-slicing around the symbols would remove the quantifier the definition turns on. The schema has no place for this note on a sense, so the disclosure lives here instead. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`senses[5]`	0.95	the tagger's words
senses	`double-sample tree` - THE NAME DESCRIBES THE MECHANISM AND NOT THE PROPERTY IT BUYS. `Our first algorithm, which we call a double-sample tree, achieves honesty by dividing its training subsample into two halves.` Honesty is the requirement; two samples is one way to meet it. A name for the means, in a paper whose theorems are all about the end - which is why `honesty` and `double-sample` are not interchangeable even though this paper's only honest algorithm is a double-sample one. Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`senses[6]`	0.9	the tagger's words
claim_relations	extends → random forests (Breiman) for statistical inference Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`claim_relations[0]`		the tagger's words
claim_relations	extends → Breiman's random forest algorithm [Breiman, 2001a] Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`claim_relations[1]`		the tagger's words
claim_relations	builds-on → the honest causal trees of Athey and Imbens [2016] Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`claim_relations[2]`		the tagger's words
claim_relations	extends → the asymptotic normality result of Mentch and Hooker [2016] Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`claim_relations[3]`		the tagger's words
claim_relations	builds-on → the infinitesimal jackknife for random forests of Efron [2014] and Wager et al. [2014] Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`claim_relations[4]`		the tagger's words
concept_edges	honesty —operationalised-as→ double-sample trees Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. strength of the relation: 0.9 · note: The condition is named first and realised second: '…1, can always be used…', and propensity trees give '…WITHOUT SAMPLE SPLITTING…' - so one condition has two constructions, only one of which splits the sample. Audit 2026-09-28: DOUBTFUL - read against its span and kept, but the span says double-sample trees can be used to build honest trees; operationalised-as is loose. also in: honesty · double-sample trees	`concept_edges[0]`	0.95	the tagger's words
concept_edges	subsample size —causes→ confidence intervals Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. differs in: THE RATE AT WHICH THE SUBSAMPLE GROWS. 'the bias of the random forest decays as 1/sqrt(s_n), while its variance decays as s_n/n. IF s_n/sqrt(n) -> 0, the squared bias decays SLOWER than the variance, and so confidence intervals built using the resulting Gaussian limit distribution WILL NOT COVER' the target. Two asymptotic-normality results for random forests differ on this one exponent and on nothing a reader would notice from the statement of either theorem · strength of the relation: 0.9 · note: THE PAPER NAMES THE PARAMETER ITS DISAGREEMENT TURNS ON AND SAYS WHAT GOES WRONG: '…[2016] may appear qualitatively similar to ours, it cannot…'. A Gaussian limit is not by itself a licence to build an interval - the bias has to vanish faster than the standard error, which is a condition on a tuning parameter, not on the theorem. Audit 2026-09-28: DOUBTFUL - read against its full span and kept, but the span says the CIs fail to cover if the subsample size condition holds; causes is loose. also in: subsample size · confidence intervals	`concept_edges[1]`	0.95	the tagger's words
content_tags	2 — a treatment effect is a difference between two of them Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`content_tags.quantities[0]`		the tagger's words
content_tags	1 — survival threshold in a prediction example Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`content_tags.quantities[1]`		the tagger's words
content_tags	causal forests are pointwise consistent and asymptotically Gaussian Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`content_tags.findings[0]`		the tagger's words
content_tags	first results letting any random forest be used for valid statistical inference Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`content_tags.findings[1]`		the tagger's words
content_tags	causal forests are more powerful than nearest-neighbor matching Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`content_tags.findings[2]`		the tagger's words
content_tags	the causal forest's advantage over kNN grows with the number of covariates Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above.	`content_tags.findings[3]`		the tagger's words
content_tags	treatment effect Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: treatment effect	`content_tags.variables[0]`		the tagger's words
content_tags	number of covariates Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: number of covariates	`content_tags.variables[1]`		the tagger's words
content_tags	confidence intervals Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: confidence intervals	`content_tags.variables[2]`		the tagger's words
content_tags	honest trees Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: honest trees	`content_tags.variables[3]`		the tagger's words
content_tags	causal forest Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: causal forest	`content_tags.definitions[0]`		the tagger's words
content_tags	potential outcomes framework with unconfoundedness Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: potential outcomes framework with unconfoundedness	`content_tags.definitions[1]`		the tagger's words
content_tags	honesty Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: honesty	`content_tags.definitions[2]`		the tagger's words
content_tags	heterogeneous treatment effects Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: heterogeneous treatment effects	`content_tags.definitions[3]`		the tagger's words
content_tags	ANOVA Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: ANOVA	`content_tags.statistics[0]`		the tagger's words
content_tags	Bayesian Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: Bayesian	`content_tags.statistics[1]`		the tagger's words
content_tags	bootstrap Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: bootstrap	`content_tags.statistics[2]`		the tagger's words
content_tags	confidence-interval Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. about this quote: QUOTE REPAIRED: the extractor split a hyphen-space and the quote was recorded faithfully with the damage in it, which made it unanchorable. The repaired string is an EXACT SUBSTRING of the staged text - that is why it was accepted, not because a rule produced it. The text as originally recorded is kept in evidence as extracted. also in: confidence-interval	`content_tags.statistics[3]`		the tagger's words
content_tags	mean Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. also in: mean	`content_tags.statistics[5]`		the tagger's words
content_tags	sample-size Quotation withheld — this record is not cleared for redistribution. The sentence is in the paper at the link above. about this quote: QUOTE RECOVERED FROM THE PAPER'S OWN CHARACTERS. The recorded quote was LETTERS-ONLY IDENTICAL to this stretch of the staged text but not an exact substring of it - spaces, hyphens, ligature glyphs or mathematical operators differed, so it could never anchor. This is the file's own text between the same two letters: not produced by a rule about the damage, copied out of the file. Round-trip checked (the recovered span is letters-only equal to the original) and length-checked. The text as originally recorded is kept in evidence as extracted. also in: sample-size	`content_tags.statistics[7]`		the tagger's words

Interpretive choices

Tags that could not be placed in the text:

none — every tag was located in the text

What was deliberately not tagged, and why, is recorded per paper by the tagger. Where a paper has no such record, this page says so rather than implying that nothing was declined.