WILL HUMANS-IN-THE-LOOP BECOME BORGS? MERITS AND PITFALLS OF WORKING WITH AI

• 成果类型: Article
• 署名作者: Fuegener, Andreas; Grahl, Jorn; Gupta, Alok; Ketter, Wolfgang
• 署名单位: University of Cologne; University of Minnesota System; University of Minnesota Twin Cities; Erasmus University Rotterdam; Erasmus University Rotterdam - Excl Erasmus MC
• 刊物名称: MIS QUARTERLY
• ISSN/ISSBN: 0276-7783
• DOI: 10.25300/MISQ/2021/16553
• 发表日期: 2021
• 页码: 1527-1556
• 关键词: Organizational design; intelligence; ability; wisdom; heads; team

摘要

We analyze how advice from an AI affects complementarities between humans and AI, in particular what humans know that an AI does not know: unique human knowledge. In a multi-method study consisting of an analytical model, experimental studies, and a simulation study, our main finding is that human choices converge toward similar responses improving individual accuracy. However, as overall individual accu-racy of the group of humans improves, the individual unique human knowledge decreases. Based on this finding, we claim that humans interacting with AI behave like Borgs, that is, cyborg creatures with strong individual performance but no human individuality. We argue that the loss of unique human knowledge may lead to several undesirable outcomes in a host of human-AI decision environments. We demonstrate this harmful impact on the wisdom of crowds. Simulation results based on our experimental data suggest that groups of humans interacting with AI are far less effective as compared to human groups without AI assistance. We suggest mitigation techniques to create environments that can provide the best of both worlds (e.g., by personalizing AI advice). We show that such interventions perform well individually as well as in wisdom of crowds settings.