Convex models, MLE and misspecification

• 成果类型: Article
• 署名作者: Patilea, V
• 署名单位: Universite de Orleans
• 刊物名称: ANNALS OF STATISTICS
• ISSN/ISSBN: 0090-5364
• DOI: 10.1214/aos/996986503
• 发表日期: 2001
• 页码: 94-123
• 关键词: MAXIMUM-LIKELIHOOD ESTIMATORS; CONVERGENCE; Consistency; rates

摘要

We analyze the asymptotic behavior of maximum likelihood estimators (MLE) in convex dominated models when the true distribution generating the independent data does not necessarily belong to the model. Inspired by the Hellinger distance and its properties, we introduce a family of divergences (contrast functions) which allow a unified treatment of well- and misspecified convex models. Convergence and rates of convergence of the MLE with respect to our divergences are obtained from inequalities satisfied by these divergences and results from empirical process theory (uniform laws of large numbers and maximal inequalities). As a particular case we recover existing results for Hellinger convergence of MLE in well-specified convex models. Four examples are considered: mixtures of discrete distributions, monotone densities, decreasing failure rate distributions and a finite-dimensional parametric model.