Adjusting for Confounding with Text Matching
American Journal of Political Science 64(4): 887-903, 2020.

Abstract
Abstract: We identify situations in which conditioning on text can address confounding in observational studies. We argue that a matching approach is particularly well-suited to this task, but existing matching methods are ill-equipped to handle high-dimensional text data. Our proposed solution is to estimate a low-dimensional summary of the text and condition on this summary via matching. We propose a method of text matching, topical inverse regression matching, that allows the analyst to match both on the topical content of confounding documents and the probability that each of these documents is treated. We validate our approach and illustrate the importance of conditioning on text to address confounding with two applications: the effect of perceptions of author gender on citation counts in the international relations literature and the effects of censorship on Chinese social media users.
Related Publications
- [Paper] How to Make Causal Inferences Using Texts
- [Paper] Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond
- [Book] Text as Data: A New Framework for Machine Learning and the Social Sciences
- [Paper] A Model of Text for Experimentation in the Social Sciences
- [Paper] Using Large Language Model Annotations for the Social Sciences: A General Framework of Using Predicted Variables in Downstream Analyses
- [Conference Proceedings] Using Imperfect Surrogates for Downstream Inference: Design-Based Supervised Learning for Social Science Applications of Large Language Models
- [Paper] Computer-Assisted Text Analysis for Comparative Politics
- [Paper] State Media Control Influences Large Language Models