Beyond baseline and follow-up: The case for more T in experiments

成果类型:
Article
署名作者:
McKenzie, David
署名单位:
The World Bank
刊物名称:
JOURNAL OF DEVELOPMENT ECONOMICS
ISSN/ISSBN:
0304-3878
DOI:
10.1016/j.jdeveco.2012.01.002
发表日期:
2012
页码:
210-221
关键词:
randomized experiments Multiple measurements Program evaluation
摘要:
The vast majority of randomized experiments in economics rely on a single baseline and single follow-up survey. While such a design is suitable for study of highly autocorrelated and relatively precisely measured outcomes in the health and education domains, it is unlikely to be optimal for measuring noisy and relatively less autocorrelated outcomes such as business profits, and household incomes and expenditures. Taking multiple measurements of such outcomes at relatively short intervals allows one to average out noise, increasing power. When the outcomes have low autocorrelation and budget is limited, it can make sense to do no baseline at all. Moreover, I show how for such outcomes, more power can be achieved with multiple follow-ups than allocating the same total sample size over a single follow-up and baseline. I also highlight the large gains in power from ANCOVA analysis rather than difference-in-differences analysis when autocorrelations are low. (C) 2012 Elsevier B.V. All rights reserved.