Unbiased approximations of products of expectations

• 成果类型: Article
• 署名作者: Lee, A.; Tiberi, S.; Zanella, G.
• 署名单位: University of Bristol; University of Zurich; University of Zurich; Swiss Institute of Bioinformatics; Bocconi University; Bocconi University
• 刊物名称: BIOMETRIKA
• ISSN/ISSBN: 0006-3444
• DOI: 10.1093/biomet/asz008
• 发表日期: 2019
• 页码: 708715
• 关键词: bayesian computation; permanent

摘要

We consider the problem of approximating the product of n expectations with respect to a common probability distribution mu. Such products routinely arise in statistics as values of the likelihood in latent variable models. Motivated by pseudo-marginal Markov chain Monte Carlo schemes, we focus on unbiased estimators of such products. The standard approach is to sample N particles from mu and assign each particle to one of the expectations; this is wasteful and typically requires the number of particles to grow quadratically with the number of expectations. We propose an alternative estimator that approximates each expectation using most of the particles while preserving unbiasedness, which is computationally more efficient when the cost of simulations greatly exceeds the cost of likelihood evaluations. We carefully study the properties of our proposed estimator, showing that in latent variable contexts it needs only O(n) particles to match the performance of the standard approach with O(n(2)) particles. We demonstrate the procedure on two latent variable examples from approximate Bayesian computation and single-cell gene expression analysis, observing computational gains by factors of about 25 and 450, respectively.