Quasi-stationary Monte Carlo and the ScaLE algorithm

• 成果类型: Article
• 署名作者: Pollock, Murray; Fearnhead, Paul; Johansen, Adam M.; Roberts, Gareth O.
• 署名单位: University of Warwick; Lancaster University
• 刊物名称: JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY
• ISSN/ISSBN: 1369-7412
• DOI: 10.1111/rssb.12365
• 发表日期: 2020
• 页码: 1167-1221
• 关键词: interacting particle-systems; stochastic-approximation; exact simulation; feynman-kac; distributions; DIFFUSIONS; SPACES

摘要

This paper introduces a class of Monte Carlo algorithms which are based on the simulation of a Markov process whose quasi-stationary distribution coincides with a distribution of interest. This differs fundamentally from, say, current Markov chain Monte Carlo methods which simulate a Markov chain whose stationary distribution is the target. We show how to approximate distributions of interest by carefully combining sequential Monte Carlo methods with methodology for the exact simulation of diffusions. The methodology introduced here is particularly promising in that it is applicable to the same class of problems as gradient-based Markov chain Monte Carlo algorithms but entirely circumvents the need to conduct Metropolis-Hastings type accept-reject steps while retaining exactness: the paper gives theoretical guarantees ensuring that the algorithm has the correct limiting target distribution. Furthermore, this methodology is highly amenable to 'big data' problems. By employing a modification to existing naive subsampling and control variate techniques it is possible to obtain an algorithm which is still exact but has sublinear iterative cost as a function of data size.