APPROXIMATION BY LOG-CONCAVE DISTRIBUTIONS, WITH APPLICATIONS TO REGRESSION

• 成果类型: Article
• 署名作者: Duembgen, Lutz; Samworth, Richard; Schuhmacher, Dominic
• 署名单位: University of Bern; University of Cambridge
• 刊物名称: ANNALS OF STATISTICS
• ISSN/ISSBN: 0090-5364
• DOI: 10.1214/10-AOS853
• 发表日期: 2011
• 页码: 702-730
• 关键词: maximum-likelihood-estimation; density; inference

摘要

We study the approximation of arbitrary distributions P on d-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback Leibler-type functional. We show that such an approximation exists if and only if P has finite first moments and is not supported by some hyperplane. Furthermore we show that this approximation depends continuously on P with respect to Mallows distance D-1(.,.). This result implies consistency of the maximum likelihood estimator of a log-concave density under fairly general conditions. It also allows us to prove existence and consistency of estimators in regression models with a response Y = mu(X) + epsilon, where X and epsilon are independent, mu(.) belongs to a certain class of regression functions while E is a random error with log-concave density and mean zero.