Exhaustive or exhausting? Evidence on respondent fatigue in long surveys

• 成果类型: Article
• 署名作者: Jeong, Dahyeon; Aggarwal, Shilpa; Robinson, Jonathan; Kumar, Naresh; Spearot, Alan; Park, David Sungho
• 署名单位: The World Bank; Indian School of Business (ISB); University of California System; University of California Santa Cruz; National Bureau of Economic Research; KDI School of Public Policy & Management
• 刊物名称: JOURNAL OF DEVELOPMENT ECONOMICS
• ISSN/ISSBN: 0304-3878
• DOI: 10.1016/j.jdeveco.2022.102992
• 发表日期: 2023
• 关键词: Survey fatigue; Measurement Suevey methodology; Design of experiments

摘要

Living standards measurement surveys require sustained attention for several hours. We quantify survey fatigue by randomizing the order of questions in 2-3 hour-long in-person surveys. An additional hour of survey time increases the probability that a respondent skips a question by 10%-64%. Because skips are more common, the total monetary value of aggregated categories such as assets or expenditures declines as the survey goes on, and this effect is sizeable for some categories: for example, an extra hour of survey time lowers food expenditures by 25%. We find similar effect sizes within phone surveys in which respondents were already familiar with questions, suggesting that cognitive burden may be a key driver of survey fatigue.