p-Hacking, Data type and Data-Sharing Policy

• 成果类型: Article
• 署名作者: Brodeur, Abel; Cook, Nikolai; Neisser, Carina
• 署名单位: University of Ottawa; Wilfrid Laurier University; University of Cologne; IZA Institute Labor Economics
• 刊物名称: ECONOMIC JOURNAL
• ISSN/ISSBN: 0013-0133
• DOI: 10.1093/ej/uead104
• 发表日期: 2024
• 页码: 985-1018
• 关键词: publication bias; ECONOMICS; TRANSPARENCY; replication; reproducibility; facts

摘要

This paper examines the relationship between p-hacking, publication bias and data-sharing policies. We collect 38,876 test statistics from 1,106 articles published in leading economic journals between 2002-20. We find that, while data-sharing policies increase the provision of data, they do not decrease the extent of p-hacking and publication bias. Similarly, articles that use hard-to-access administrative data or third-party surveys, as compared to those that use easier-to-access (e.g., author-collected) data, are not different in their p-hacking and publication extent. Voluntary provision of data by authors on their home pages offers no evidence of reduced p-hacking.