What Is Your Estimand? Defining the Target Quantity Connects Statistical Evidence to Theory
American Sociological Review 86(3): 532-565, 2021.

Abstract
We make only one point in this article. Every quantitative study must be able to answer the question: what is your estimand? The estimand is the target quantity—the purpose of the statistical analysis. Much attention is already placed on how to do estimation; a similar degree of care should be given to defining the thing we are estimating. We advocate that authors state the central quantity of each analysis—the theoretical estimand—in precise terms that exist outside of any statistical model. In our framework, researchers do three things: (1) set a theoretical estimand, clearly connecting this quantity to theory; (2) link to an empirical estimand, which is informative about the theoretical estimand under some identification assumptions; and (3) learn from data. Adding precise estimands to research practice expands the space of theoretical questions, clarifies how evidence can speak to those questions, and unlocks new tools for estimation. By grounding all three steps in a precise statement of the target quantity, our framework connects statistical evidence to theory.
Related Publications
- [Paper] Comment: Summarizing Income Mobility with Multiple Smooth Quantiles Instead of Parameterized Means
- [Paper] Handle with Care: A Sociologist's Guide to Causal Inference with Instrumental Variables
- [Paper] What Good Is a Regression? Inference to the Best Explanation and the Practice of Political Science Research
- [Working Paper] Where's the Evidence that Respondents Understand Your Survey Questions?
- [Paper] Correcting the Measurement Errors of AI-Assisted Labeling in Image Analysis Using Design-Based Supervised Learning
- [Paper] Short-Term Exposure to "Filter-Bubble" Recommendation Systems Has Limited Polarization Effects: Naturalistic Experiments on YouTube
- [Paper] Measuring Distances in High-Dimensional Spaces: Why Average Group Vector Comparisons Exhibit Bias, and What to Do About It
- [Paper] REFORMS: Consensus-Based Recommendations for Machine-Learning-Based Science