Optimized annealed sequential Monte Carlo samplers

• 成果类型: Article; Early Access
• 署名作者: Syed, Saifuddin; Bouchard-Cote, Alexandre; Chern, Kevin; Doucet, Arnaud
• 署名单位: University of British Columbia; University of Oxford
• 刊物名称: JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY
• ISSN/ISSBN: 1369-7412; 1467-9868
• DOI: 10.1093/jrsssb/qkag082
• 发表日期: 2026-08-04
• 关键词: annealed importance sampling; Annealing; normalizing constant estimation; parallel tempering; sequential Monte Carlo samplers; inference; EFFICIENCY; exchange; schemes

摘要

Annealed sequential Monte Carlo (ASMC) samplers are special cases of SMC samplers where the sequence of distributions can be embedded in a smooth path of distributions. Using this underlying path and a performance model based on the variance of the normalizing constant estimator, we systematically study dense-schedule limits. From our theory emerges a notion of global barrier, capturing the inherent complexity of normalizing constant approximation under our performance model. We then turn the resulting approximations into surrogate objective functions of algorithm performance, using them to guide method development. This leads to novel adaptive methods, optimized annealed SMC (OASMC), which address practical difficulties inherent in previous adaptive SMC methods. First, our OASMC algorithms are predictable: they produce a sequence of increasingly precise estimates at deterministic, known times. Second, optimized annealed importance sampling (OAIS), a special case of OASMC, enables schedule adaptation at a memory cost constant in the number of particles, requiring significantly less communication. Finally, these characteristics make OAIS highly efficient on GPUs. We provide an open-source, high-performance GPU implementation of our method and demonstrate up to a hundred-fold speed improvement compared to state-of-the-art adaptive AIS methods.