In search of lost mixing time: adaptive Markov chain Monte Carlo schemes for Bayesian variable selection with very large p

成果类型:
Article
署名作者:
Griffin, J. E.; Latuszynski, K. G.; Steel, M. F. J.
署名单位:
University of London; University College London; University of Warwick
刊物名称:
BIOMETRIKA
ISSN/ISSBN:
0006-3444
DOI:
10.1093/biomet/asaa055
发表日期:
2021
页码:
5369
关键词:
摘要:
The availability of datasets with large numbers of variables is rapidly increasing. The effective application of Bayesian variable selection methods for regression with these datasets has proved difficult since available Markov chain Monte Carlo methods do not perform well in typical problem sizes of interest. We propose new adaptive Markov chain Monte Carlo algorithms to address this shortcoming. The adaptive design of these algorithms exploits the observation that in large-p, small-n settings, the majority of the p variables will be approximately uncorrelated a posteriori. The algorithms adaptively build suitable nonlocal proposals that result in moves with squared jumping distance significantly larger than standard methods. Their performance is studied empirically in high-dimensional problems and speed-ups of up to four orders of magnitude are observed.