ON STOCHASTIC COMPLEXITY AND NONPARAMETRIC DENSITY-ESTIMATION

成果类型:
Article
署名作者:
HALL, P; HANNAN, EJ
刊物名称:
BIOMETRIKA
ISSN/ISSBN:
0006-3444
发表日期:
1988
页码:
705714
关键词:
摘要:
We use the concepts of stochastic complexity, description length, and model selection to develop data-based methods for choosing smoothing parameters in nonparametric density estimation. In the case of histogram estimators, we derive a simple, exact formula for stochastic complexity when the prior distribution of cell probabilities is uniform over the class of all possible choices. The formula depends only on the data and the smoothing parameter, which is readily chosen according to the criterion of minimum stochastic complexity. Approaches based on stochastic complexity and description length are shown to be asymptotically equivalent in certain circumstances. They produce a degree of smoothing which is almost optimal from the viewpoint of minimizing L.infin., or supremum, distance, but which smooths a little more than is optimal in the sense of minimizing Lr distance for any finite value of r.