Search results

Aims: It is common in the context of evaluations that participants have not been selected on the basis of transparent participation criteria, and researchers and evaluators many times have to make do with observational data to estimate effects of job training programs and similar interventions. The techniques developed by researchers in such endeavours are useful not only to researchers narrowly focused on evaluations, but also to social and population science more generally, as observational data overwhelmingly are the norm, and the endogeneity challenges encountered in the estimation of causal effects with such data are not trivial. The aim of this article is to illustrate how register data can be used strategically to evaluate programs and interventions and to estimate causal effects of participation in these. Methods: We use propensity score matching on pretreatment-period variables to derive a synthetic control group, and we use this group as a comparison to estimate the employment-treatment effect of participation in a large job-training program. Results: We find the effect of treatment to be small and positive but transient. Conclusions: Our method reveals a strong regression to the mean effect, extremely easy to interpret as a treatment effect had a less advanced design been used (e.g. a within-subjects panel data analysis), and illustrates one of the unique advantages of using population register data for research purposes. ; Funding Agencies|European Social Fund in Sweden; European Research Council under European Union [324233]; Riksbankens Jubileumsfond [M12-0301:1]; Swedish Research Council [445-2013-7681, 340-2013-5460]

Synthetic control is a causal inference tool used to estimate the treatment effects of an intervention by creating synthetic counterfactual data. This approach combines measurements from other similar observations (i.e., donor pool) to predict a counterfactual time series of interest (i.e., target unit) by analyzing the relationship between the target and the donor pool before the intervention. As synthetic control tools are increasingly applied to sensitive or proprietary data, formal privacy protections are often required. In this work, we provide the first algorithms for differentially private synthetic control with explicit error bounds. Our approach builds upon tools from non-private synthetic control and differentially private empirical risk minimization. We provide upper and lower bounds on the sensitivity of the synthetic control query and provide explicit error bounds on the accuracy of our private synthetic control algorithms. We show that our algorithms produce accurate predictions for the target unit and that the cost of privacy is small. Finally, we empirically evaluate the performance of our algorithm, and show favorable performance in a variety of parameter regimes, as well as provide guidance to practitioners for hyperparameter tuning.

We use the synthetic control method to estimate the effect of international banking and energy sanctions from 2012 to 2015 on military spending of Iran. We create a synthetic control group that mimics the socioeconomic characteristics of Iran before the international sanctions of 2012. We then compare the military spending of the counterfactual Iran without sanction to the factual Iran with sanction for the period of 2003-2015. Over the entire 2013–2015 period, per capita military spending was reduced by about 119 US$ per year on average, which amounts to approximately 54% of the 2012 baseline level. Our findings are robust to a series of tests, including placebo tests.

AbstractWe evaluate whether a lack of guidance on how to choose the matching variables used in the Synthetic Control (SC) estimator creates specification‐searching opportunities. We provide theoretical results showing that specification‐searching opportunities are asymptotically irrelevant if we restrict to a subset of SC specifications. However, based on Monte Carlo simulations and simulations with real datasets, we show significant room for specification searching when the number of pre‐treatment periods is in line with common SC applications, and when alternative specifications commonly used in SC applications are also considered. This suggests that such lack of guidance generates a substantial level of discretion in the choice of the comparison units in SC applications, undermining one of the advantages of the method. We provide recommendations to limit the possibilities for specification searching in the SC method. Finally, we analyze the possibilities for specification searching and provide our recommendations in a series of empirical applications.