Data augmentation for models based on rejection sampling

• 成果类型: Article
• 署名作者: Rao, Vinayak; Lin, Lizhen; Dunson, David B.
• 署名单位: Purdue University System; Purdue University; University of Texas System; University of Texas Austin; Duke University
• 刊物名称: BIOMETRIKA
• ISSN/ISSBN: 0006-3444
• DOI: 10.1093/biomet/asw005
• 发表日期: 2016
• 页码: 319335
• 关键词: normalizing constant; distributions; MULTIVARIATE; simulation; algorithms

摘要

We present a data augmentation scheme to perform Markov chain Monte Carlo inference for models where data generation involves a rejection sampling algorithm. Our idea is a simple scheme to instantiate the rejected proposals preceding each data point. The resulting joint probability over observed and rejected variables can be much simpler than the marginal distribution over the observed variables, which often involves intractable integrals. We consider three problems: modelling flow-cytometry measurements subject to truncation; the Bayesian analysis of the matrix Langevin distribution on the Stiefel manifold; and Bayesian inference for a nonparametric Gaussian process density model. The latter two are instances of doubly-intractable Markov chain Monte Carlo problems, where evaluating the likelihood is intractable. Our experiments demonstrate superior performance over state-of-the-art sampling algorithms for such problems.