Showing posts with label treatment effects. Show all posts
Showing posts with label treatment effects. Show all posts

Monday, February 14, 2011

The Strange Powers of the Placebo Effect

The placebo effect is well known but not widely understood. This is a nice summary of how its effectiveness varies in strange ways.

Monday, October 18, 2010

Secrets and lies: is a lot of medical research bunk?

Social scientists & certainly economists tend to look up to medical research, partly because its where the money is, and also because one of its key methods, the randomized control trial, is seen by many as providing a "gold standard" when it comes to measuring treatment effects - though Deaton, Heckman and others have questioned whether RCTs in economics should enjoy this privileged status.
The public generally tend to hold medical research in even higher respect. Medical researchers are good people, passionately if objectively, pushing back the frontiers of knowledge to help make us better.
So how worrying would it be if much medical research was actually wrong? This conclusion has been emerging from the work of a Greek medical researcher, John Ioannidis, and his team. The causes of this problem are various, including publication bias, and are well known but the scale of the problem is probably not. This article may make you distinctly uneasy.
Part of the problem, that key studies have not been replicated and may be wrong, is not peculiar to medicine. It may well plague the social and behavioural sciences too. This article on the subject won't make you feel any better.

Friday, October 8, 2010

Stata resources for treatment effects

There are a large number of resources within Stata for the estimation of treatment effects. Some are part of official Stata and others are user written that can be easily downloaded.

To estimate regression discontinuity models, there is a download rd due to Austin Nichols. Further details at Nichols, Austin. 2007. "Causal Inference with Observational Data." Prepublication draft available at http://pped.org/stata/ciwod.pdf. It is published in the Stata Journal now I think.

To estimate IV models there are several options in Stata.
ivregress is the main program. A download ivreg2 due to Baum, Schaffer & Stillman is very useful - I recommend it. Make sure you get the latest version. Their paper should be used in conjunction with it: http://ideas.repec.org/a/tsj/stataj/v7y2007i4p465-506.html. xtivreg2 is the equivalent program for panel data.

ivtobit and ivprobit do what their names suggest. If using them, you need to satisfy yourself that they are consistent estimators. Caution is appropriate where the instrumented variable is binary. In the latter case biprobit may be better.

cmp (due to David Roodman) allows you to estimate using MLE a wide range of simultaneous models with combinations of linear and non-linear equations provide they satisfy a recursive structure.

treatreg allows the estimation of what Stata calls "treatment effects models". This is something of a misnomer since it only for a very specific model: a linear regression with an endogenous dummy.

condivreg
estimates IV models with a single endogenous variable and provides an exact confidence interval for the slope as opposed to the usual asymptotic one. It is particularly useful if weak instruments are a concern.

For estimating Treatment effects using Propensity Score matching there are several downloads including: psmatch2 (Leuven & Sianesi) which does a wide range of matching estimators and nnmatch which does nearest neighbour matching. psbalance allows you to test covariate balance after matching - something that is recomended.

Monday, September 27, 2010

Regression as a matching estimator: Oaxaca-Blinder rides again

Propensity score matching is a well known method of estimating treatments effects with observational data where the treatment is binary and it is assumed there is no selection on unobservables. To recall: one has data on individuals who have been treated. One would like to form a control who are otherwise identical (on average) but who were not treated.
One could match on characteristics but if the dimension of the X's is high that gets very difficult. It turns out that, due to a famous result of Rosenbaum & Rubin, given a key assumption, matching on the probability of being treated (the propensity) is equivalent.
So the norm is to model this probability with say a logit or probit, estimate the predicted probability and form your control group. There are several ways of doing this.
So what if you used a linear probability model instead? Well it turns out that, like speaking prose, you may have been doing this all along without realizing it. In a recent paper P. Kline shows that such a procedure is equivalent to our old friend the Oaxaca-Blinder estimator well known to de-composers. Aside from being easy to do it has several other nice features like being unbiased in finite samples and ensuring exact covariate balance between the two groups in circumstances where it is not guaranteed by other estimators.
For a nice introduction to matching methods see Conniffe et al.