STOCHASTIC APPROXIMATION, COOPERATIVE DYNAMICS AND SUPERMODULAR GAMES

• 成果类型: Article
• 署名作者: Benaim, Michel; Faure, Mathieu
• 署名单位: University of Neuchatel
• 刊物名称: ANNALS OF APPLIED PROBABILITY
• ISSN/ISSBN: 1050-5164
• DOI: 10.1214/11-AAP816
• 发表日期: 2012
• 页码: 2133-2164
• 关键词: differential-equations; mixed equilibria; Fictitious play; algorithms; CONVERGENCE; systems; average; points

摘要

This paper considers a stochastic approximation algorithm, with decreasing step size and martingale difference noise. Under very mild assumptions, we prove the nonconvergence of this process toward a certain class of repulsive sets for the associated ordinary differential equation (ODE). We then use this result to derive the convergence of the process when the ODE is cooperative in the sense of Hirsch [SIAM J. Math. Anal. 16 (1985) 423-439]. In particular, this allows us to extend significantly the main result of Hofbauer and Sandholm [Econometrica 70 (2002) 2265-2294] on the convergence of stochastic fictitious play in supermodular games.