A conditional density estimation partition model using logistic Gaussian processes

• 成果类型: Article
• 署名作者: Payne, R. D.; Guha, N.; Ding, Y.; Mallick, B. K.
• 署名单位: Eli Lilly; Lilly Research Laboratories; University of Massachusetts System; University of Massachusetts Lowell; Texas A&M University System; Texas A&M University College Station; Texas A&M University System; Texas A&M University College Station
• 刊物名称: BIOMETRIKA
• ISSN/ISSBN: 0006-3444
• DOI: 10.1093/biomet/asz064
• 发表日期: 2020
• 页码: 173190
• 关键词: posterior consistency; regression; mixtures; rates

摘要

Conditional density estimation seeks to model the distribution of a response variable conditional on covariates. We propose a Bayesian partition model using logistic Gaussian processes to perform conditional density estimation. The partition takes the form of a Voronoi tessellation and is learned from the data using a reversible jump Markov chain Monte Carlo algorithm. The methodology models data in which the density changes sharply throughout the covariate space, and can be used to determine where important changes in the density occur. The Markov chain Monte Carlo algorithm involves a Laplace approximation on the latent variables of the logistic Gaussian process model which marginalizes the parameters in each partition element, allowing an efficient search of the approximate posterior distribution of the tessellation. The method is consistent when the density is piecewise constant in the covariate space or when the density is Lipschitz continuous with respect to the covariates. In simulation and application to wind turbine data, the model successfully estimates the partition structure and conditional distribution.