Voice-based AI in call center customer service: A natural field experiment

• 成果类型: Article
• 署名作者: Wang, Lingli; Huang, Ni; Hong, Yili; Liu, Luning; Guo, Xunhua; Chen, Guoqing
• 署名单位: Beijing University of Posts & Telecommunications; University of Miami; Harbin Institute of Technology; Tsinghua University; Harbin Institute of Technology
• 刊物名称: PRODUCTION AND OPERATIONS MANAGEMENT
• ISSN/ISSBN: 1059-1478
• DOI: 10.1111/poms.13953
• 发表日期: 2023
• 页码: 1002-1018
• 关键词: Artificial intelligence; customer service; difference-in-differences; Natural field experiment; service flexibility

摘要

Voice-based artificial intelligence (AI) systems have been recently deployed to replace traditional interactive voice response (IVR) systems in call center customer service. However, there is little evidence that sheds light on how the implementation of AI systems impacts customer behavior, as well as AI systems' effects on call center customer service performance. By leveraging the proprietary data obtained from a natural field experiment in a large telecommunication company, we examine how the introduction of a voice-based AI system affects call length, customers' demand for human service, and customer complaints in call center customer service. We find that the implementation of the AI system temporarily increases the duration of machine service and customers' demand for human service; however, it persistently reduces customer complaints. Furthermore, our results reveal interesting heterogeneity in the effectiveness of the voice-based AI system. For relatively simple service requests, the AI system reduces customer complaints for both experienced and inexperienced customers. However, for complex requests, customers appear to learn from the prior experience of interacting with the AI system, which leads to fewer complaints. Moreover, the AI-based system has a significantly larger effect on reducing customer complaints for older and female customers as well as for customers who have had extensive experience using the IVR system. Finally, we find that speech-recognition failures in customer-AI interactions lead to increases in customers' demand for human service and customer complaints. The results from this study provide implications for the implementation of an AI system in call center operations.