Measuring the measurement error: A method to qualitatively validate survey data

• 成果类型: Article
• 署名作者: Blattman, Christopher; Jamison, Julian; Koroknay-Palicz, Tricia; Rodrigues, Katherine; Sheridan, Margaret
• 署名单位: Columbia University; The World Bank; The World Bank; University of North Carolina; University of North Carolina Chapel Hill
• 刊物名称: JOURNAL OF DEVELOPMENT ECONOMICS
• ISSN/ISSBN: 0304-3878
• DOI: 10.1016/j.jdeveco.2016.01.005
• 发表日期: 2016
• 页码: 99-112
• 关键词: Measurement error; survey data; validation; field experiments; Liberia; crime; drugs; Risky behaviors

摘要

Empirical social science relies heavily on self-reported data, but subjects may misreport behaviors, especially sensitive ones such as crime or drug abuse. If a treatment influences survey misreporting, it biases causal estimates. We develop a validation technique that uses intensive qualitative work to assess survey misreporting and pilot it in a field experiment where subjects were assigned to receive cash, therapy, both, or neither. According to survey responses, both treatments reduced crime and other sensitive behaviors. Local researchers spent several days with a random subsample of subjects after surveys, building trust and obtaining verbal confirmation of four sensitive behaviors and two expenditures. In this instance, validation showed survey underreporting of most sensitive behaviors was low and uncorrelated with treatment, while expenditures were under reported in the survey across all arms, but especially in the control group. We use these data to develop measurement error bounds on treatment effects estimated from surveys. (C) 2016 Published by Elsevier B.V.