Can humans detect errors in data? Impact of base rates, incentives, and goals

• 成果类型: Review
• 署名作者: Klein, BD; Goodhue, DL; Davis, GB
• 署名单位: University System of Georgia; University of Georgia; University of Minnesota System; University of Minnesota Twin Cities
• 刊物名称: MIS QUARTERLY
• ISSN/ISSBN: 0276-7783
• DOI: 10.2307/249418
• 发表日期: 1997
• 页码: 169-194
• 关键词: signal-detection theory; data quality; information-systems; task-performance; rate fallacy; accuracy; predictions; instruction; COMMITMENT; PSYCHOLOGY

摘要

There is strong evidence that data items stored in organizational databases have a significant rate of errors. If undetected in use, those errors in stored data may significantly affect business outcomes. Published research suggests that users of information systems tend to be ineffective in detecting data errors. However, in this paper it is argued that, rather than accepting poor human error detection performance, MIS researchers need to develop better theories of human error detection and to improve their understanding of the conditions for improving performance. This paper applies several theory bases (primarily signal detection theory but also a theory of individual task performance, theories of effort and accuracy in decision making, and theories of goals and incentives) to develop a set of propositions about successful human error detection. These propositions are tested in a laboratory setting. The results present a strong challenge to earlier assertions that humans are poor detectors of data errors. The findings of the two laboratory experiments show that explicit error detection goals and incentives can modify error detection performance. These findings provide an improved understanding of conditions under which users detect data errors. They indicate it is possible to influence detection behavior in organizational settings through managerial directives, training, and incentives.