Variational Bayes for Fast and Accurate Empirical Likelihood Inference

• 成果类型: Article
• 署名作者: Yu, Weichang; Bondell, Howard D.
• 署名单位: University of Melbourne
• 刊物名称: JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION
• ISSN/ISSBN: 0162-1459
• DOI: 10.1080/01621459.2023.2169701
• 发表日期: 2024
• 页码: 1089-1101
• 关键词: race

摘要

We develop a fast and accurate approach to approximate posterior distributions in the Bayesian empirical likelihood framework. Bayesian empirical likelihood allows for the use of Bayesian shrinkage without specification of a full likelihood but is notorious for leading to several computational difficulties. By coupling the stochastic variational Bayes procedure with an adjusted empirical likelihood framework, the proposed method overcomes the intractability of both the exact posterior and the arising evidence lower bound objective, and the mismatch between the exact posterior support and the variational posterior support. The optimization algorithm achieves fast algorithmic convergence by using the variational expected gradient of the log adjusted empirical likelihood function. We prove the consistency of the proposed approximate posterior distribution and an empirical likelihood analogue of the variational Bernstein-von-Mises theorem. Through several numerical examples, we confirm the accuracy and quick algorithmic convergence of our proposed method.