Autonomous algorithmic collusion: Q-learning under sequential pricing

• 成果类型: Article
• 署名作者: Klein, Timo
• 署名单位: Utrecht University
• 刊物名称: RAND JOURNAL OF ECONOMICS
• ISSN/ISSBN: 0741-6261
• DOI: 10.1111/1756-2171.12383
• 发表日期: 2021
• 页码: 538-558
• 关键词: artificial-intelligence; multiagent; COMPETITION; go; oligopoly; prices; game

摘要

Prices are increasingly set by algorithms. One concern is that intelligent algorithms may learn to collude on higher prices even in the absence of the kind of coordination necessary to establish an antitrust infringement. However, exactly how this may happen is an open question. I show how in simulated sequential competition, competing reinforcement learning algorithms can indeed learn to converge to collusive equilibria when the set of discrete prices is limited. When this set increases, the algorithm considered increasingly converges to supra-competitive asymmetric cycles. I show that results are robust to various extensions and discuss practical limitations and policy implications.