BAYESIAN VARIABLE SELECTION WITH SHRINKING AND DIFFUSING PRIORS

• 成果类型: Article
• 署名作者: Narisetty, Naveen Naidu; He, Xuming
• 署名单位: University of Michigan System; University of Michigan
• 刊物名称: ANNALS OF STATISTICS
• ISSN/ISSBN: 0090-5364
• DOI: 10.1214/14-AOS1207
• 发表日期: 2014
• 页码: 789-817
• 关键词: regression shrinkage; DANTZIG SELECTOR; model selection; likelihood; spike; Consistency; dimension

摘要

We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the well-known spike and slab Gaussian priors with a distinct feature, that is, the prior variances depend on the sample size through which appropriate shrinkage can be achieved. We show the strong selection consistency of the proposed method in the sense that the posterior probability of the true model converges to one even when the number of covariates grows nearly exponentially with the sample size. This is arguably the strongest selection consistency result that has been available in the Bayesian variable selection literature; yet the proposed method can be carried out through posterior sampling with a simple Gibbs sampler. Furthermore, we argue that the proposed method is asymptotically similar to model selection with the Lo penalty. We also demonstrate through empirical work the fine performance of the proposed approach relative to some state of the art alternatives.