Three Essays on Causal Inference for Observational Studies


Book Description

Finally, the third paper in this thesis addresses the question of unintended consequences in school segregation due to the introduction of a targeted voucher scheme. I use a difference-in-difference approach, in combination with matching on time-stable covariates, to estimate the effect that the 2008 Chilean voucher policy had on both average students' household income and academic performance at the school level. Results show that even though the policy had a positive effect on schools' standardized test scores, closing the gap between schools that subscribed to the policy compared to those that did not, there was also an increase in the differences between socioeconomic characteristics at the school level, such as average household income.




Three Essays on Causal Inference in Comparative Political Behavior


Book Description

This dissertation contains three independent essays, each applying statistical methods for causal inference in observational studies to central topics in comparative political behavior.




Three Essays on Causal Inference


Book Description

This thesis describes three research projects in causal inference, all related to the problem of contrasting the average counterfactual outcomes on two sides of a binary decision. In the first project, we discuss estimation of the average causal effect in a randomized control trial. Here, we find that statisticians find themselves in a kind of statistical paradise: a simple model-based procedure delivers correct confidence intervals even if the experimental participants are not randomly sampled and mis-specified models are used. In the second project, we consider the problem of testing for a treatment effect using observational data with no hidden confounders. Conceptually, this is no different from a rather complicated RCT, and one might expect that a return to statistical paradise is possible. Unfortunately, this is not the case: we show that even intuitively reasonable uses of correct models may still yield misleading conclusions. The final project looks at observational data with unobserved confounding and gives methods for computing bounds on average causal effects. Here, we discover some never-before-seen robustness properties unique to the partially-identified setting.




Three Essays in Robust Causal Inference


Book Description

Economics research often addresses questions with an implicit or explicit policy goal. When such a goal involves an active intervention, such as the assignment of a particular treatment variable to participants, the analysis of its effects requires the tools of causal inference. In such settings, the opportunity to use experimental or observational data to tease out policy parameters of interest requires a combination of statistical and causal assumptions. In reduced form work, where an explicit economic theory is not laid out to allow identification of policy parameters from data, the investigation of the causal assumptions becomes a critical exercise for the credibility of the results. Many robustness exercises evaluate the effect that relaxing and/or modifying assumptions produces on the results of the study. The scope of these exercises is very broad, reflecting the need to tailor specific robustness exercises to whichever assumptions are most likely to be violated in a given domain. This dissertation is a collection of three essays on robust causal inference that share a unifying theme: preserving the nonparametric nature of the robustness exercise. This aspect has both a theoretical and practical relevance. First, causal assumptions are usually nonparametric: robustness exercises that restrict to parametric cases might lead to misleading insights. Further, economics research has started to incorporate more flexible nonparametric and semi-parametric techniques which may call for robustness exercises that are readily applicable to these approaches. Because robustness exercises are context specific, each of these essays addresses a separate aspect of it. Chapter 1 investigates how changes in the distribution of covariates may invalidate given experimental results, with implications for evidence based policy-making. It proposes an explicit metric of robustness that measures the distance of the closest distribution of covariates for which experimental results are violated. Chapter 2 analyses the practice of robustness checks as a way to validate a researcher's identification strategy. It details out the limitations of these exercises in detecting failure of identification and proposes a non-parametric robustness test that bypasses functional form assumptions. Finally, Chapter 3 focuses on the robustness of Marginal Treatment Effect identification when the instrumental variables fail to incentivize treatment for a subset of the population. It provides two alternative identification results which can be relevant in practice.




Three Essays in Causal Inference


Book Description

This thesis is a collection of three essays on causal inference. Chapter 1 considers the problem of constructing confidence intervals or bands for the quantiles of treatment effects under settings where point identification is impossible. I show that under settings where selection is only on observables bounds for the entire quantile function can nonetheless be estimated, and this enables the estimation of confidence bands. I also extend these results to instrumental variable settings. Computational complexity analysis demonstrates that the methodology I propse is computationally attractive. Chapters 2 and 3 consider extending the synthetic control approach of Abadie, Diamond, and Haimueller (2010) to two different settings where individual-level data is available. In Chapter 2 I consider estimating average treatment effects by constructing for every subject in the treatment group a synthetic twin composed of individuals in the control group. I show that the resulting estimator is unbiased when selection is dependent only on observables. I also show that matching estimators and OLS estimators can be viewed as special cases of synthetic control estimators. Furthermore, I demonstrate that the estimator is highly scalable computationally. In Chapter 3, I consider settings where either panel data or repeated cross-sectional data is available. I show that the synthetic control estimator in this setting can yield asymptotically valid standard errors when aggregation is done from individual-level data, unlike the original work of Abadie, Diamond, and Hainmueller (2010). To demonstrate asymptotic properties, two types of asymptotic analysis are carried out: one appropriate when the number of observations at each point in time in each subpopulation tends to infinity, and one suitable for stationary aggregate data and in which the number of pre-intervention periods gets large.




Essays on Causal Inference in Observational Studies


Book Description

The third essay investigates the impact of United Nations peacekeeping following civil war. King and Zeng (2007) found that prior work on this topic (Doyle and Sambanis 2000) had been based more on indefensible modeling assumptions than on evidence. This essay revisits the Doyle and Sambanis (2000) causal questions and answers them using new matching-based methods. These new methods do not require assumptions that plagued prior work, and they are broadly applicable to many important inferential problems in political science and beyond. When the methods are applied to the Doyle and Sambanis (2000) data, there is a preponderance of evidence to suggest that UN peacekeeping has had a positive effect on peace and democracy in the aftermath of civil war.




Essays in Causal Inference


Book Description

In observational studies, identifying assumptions may fail, often quietly and without notice, leading to biased causal estimates. Although less of a concern in randomized trials where treatment is assigned at random, bias may still enter the equation through other means. This dissertation has three parts, each developing new methods to address a particular pattern or source of bias in the setting being studied. In the first part, we extend the conventional sensitivity analysis methods for observational studies to better address patterns of heterogeneous confounding in matched-pair designs. We illustrate our method with two sibling studies on the impact of schooling on earnings, where the presence of unmeasured, heterogeneous ability bias is of material concern. The second part develops a modified difference-in-difference design for comparative interrupted time series studies. The method permits partial identification of causal effects when the parallel trends assumption is violated by an interaction between group and history. The method is applied to a study of the repeal of Missouri's permit-to-purchase handgun law and its effect on firearm homicide rates. In the final part, we present a study design to identify vaccine efficacy in randomized control trials when there is no gold standard case definition. Our approach augments a two-arm randomized trial with natural variation of a genetic trait to produce a factorial experiment. The method is motivated by the inexact case definition of clinical malaria.




Observation and Experiment


Book Description

Cover -- Contents -- Preface -- Reading Options -- List of Examples -- Part I. Randomized Experiments -- 1. A Randomized Trial -- 2. Structure -- 3. Causal Inference in Randomized Experiments -- 4. Irrationality and Polio -- Part II. Observational Studies -- 5. Between Observational Studies and Experiments -- 6. Natural Experiments -- 7. Elaborate Theories -- 8. Quasi-experimental Devices -- 9. Sensitivity to Bias -- 10. Design Sensitivity -- 11. Matching Techniques -- 12. Biases from General Dispositions -- 13. Instruments -- 14. Conclusion -- Appendix: Bibliographic Remarks -- Notes -- Glossary: Notation and Technical Terms -- Suggestions for Further Reading -- Acknowledgments -- Index




Essays on Matching and Weighting for Causal Inference in Observational Studies


Book Description

A simulation study with different settings is conducted to compare the proposed weighting scheme to IPTW, including generalized propensity score estimation methods that also consider explicitly the covariate balance problem in the probability estimation process. The applicability of the methods to continuous treatments is also tested. The results show that directly targeting balance with the weights, instead of focusing on estimating treatment assignment probabilities, provides the best results in terms of bias and root mean square error of the treatment effect estimator. The effects of the intensity level of the 2010 Chilean earthquake on posttraumatic stress disorder are estimated using the proposed methodology.




Design of Observational Studies


Book Description

An observational study is an empiric investigation of effects caused by treatments when randomized experimentation is unethical or infeasible. Observational studies are common in most fields that study the effects of treatments on people, including medicine, economics, epidemiology, education, psychology, political science and sociology. The quality and strength of evidence provided by an observational study is determined largely by its design. Design of Observational Studies is both an introduction to statistical inference in observational studies and a detailed discussion of the principles that guide the design of observational studies. Design of Observational Studies is divided into four parts. Chapters 2, 3, and 5 of Part I cover concisely, in about one hundred pages, many of the ideas discussed in Rosenbaum’s Observational Studies (also published by Springer) but in a less technical fashion. Part II discusses the practical aspects of using propensity scores and other tools to create a matched comparison that balances many covariates. Part II includes a chapter on matching in R. In Part III, the concept of design sensitivity is used to appraise the relative ability of competing designs to distinguish treatment effects from biases due to unmeasured covariates. Part IV discusses planning the analysis of an observational study, with particular reference to Sir Ronald Fisher’s striking advice for observational studies, "make your theories elaborate." The second edition of his book, Observational Studies, was published by Springer in 2002.