From noise to knowledge: Improving evidentiary standards for program efficacy to better inform public policy and management decisions

• 成果类型: Article; Early Access
• 署名作者: Newcomer, Kathryn E.; Hall, Jeremy L.; Pandey, Sanjay K.; Reginal, Travis; White, Ben
• 署名单位: George Washington University; State University System of Florida; University of Central Florida
• 刊物名称: PUBLIC ADMINISTRATION REVIEW
• ISSN/ISSBN: 0033-3352
• DOI: 10.1111/puar.13688
• 发表日期: 2023
• 关键词: QUALITATIVE RESEARCH; criteria; racism; instruction; english; works

摘要

Current approaches employed by U.S.-based clearinghouses to rate the efficacy of interventions to address social problems typically do not result in sufficient information to help practitioners. Current standards of evidence employed across the United States apply a positivist notion of validity with quantitative research criteria that discourage answering important how and why questions, explicitly privilege quantitative/RCT evidence, offer few contextual insights, and rarely discuss disparities in outcomes across participants differing by race, gender, and ethnicity. We offer a set of standards of evidence to assess qualitative and mixed methods studies, as well as RCTs and quasi-experimental designs, and probe the extent to which the studies address context and equity. We applied our proposed new standards of evidence to all intervention studies rated as the highest quality by the What Works Clearinghouse (WWC) sponsored by the U.S. Department of Education from 2017 to 2021 to demonstrate the usefulness of our standards.