CONFIDENCE INTERVALS FOR MULTIPLE ISOTONIC REGRESSION AND OTHER MONOTONE MODELS

成果类型:
Article
署名作者:
Deng, Hang; Han, Qiyang; Zhang, Cun-Hui
署名单位:
Rutgers University System; Rutgers University New Brunswick
刊物名称:
ANNALS OF STATISTICS
ISSN/ISSBN:
0090-5364
DOI:
10.1214/20-AOS2025
发表日期:
2021
页码:
2021-2052
关键词:
limit distribution-theory log-concave density maximum-likelihood-estimation risk bounds Nonparametric Regression brownian-motion global rates CONVERGENCE estimators approximation
摘要:
We consider the problem of constructing pointwise confidence intervals in the multiple isotonic regression model. Recently, Han and Zhang (2020) obtained a pointwise limit distribution theory for the so-called block maxmin and min-max estimators (Fokianos, Leucht and Neumann (2020); Deng and Zhang (2020)) in this model, but inference remains a difficult problem due to the nuisance parameter in the limit distribution that involves multiple unknown partial derivatives of the true regression function. In this paper, we show that this difficult nuisance parameter can be effectively eliminated by taking advantage of information beyond point estimates in the block max-min and min-max estimators. Formally, let (u) over cap (x(0)) (resp. (v) over cap (x(0))) be the maximizing lower-left (resp. minimizing upper-right) vertex in the block max-min (resp. min-max) estimator, and (f) over cap (n) be the average of the block max-min and min-max estimators. If all (first-order) partial derivatives of f(0) are nonvanishing at x(0), then the following pivotal limit distribution theory holds: root n((u) over cap),((v) over cap)(x(0)) - f(0)(x(0))) (sic) sigma . L-1d. Here n((u) over cap), ((v) over cap)(x(0)) is the number of design points in the block [(u) over cap,(x(0)), (v) over cap (x(0))], sigma is the standard deviation of the errors, and L-1d is a universal limit distribution free of nuisance parameters. This immediately yields confidence intervals for f(0)(x(0)) with asymptotically exact confidence level and oracle length. Notably, the construction of the confidence intervals, even new in the univariate setting, requires no more efforts than performing an isotonic regression once using the block max-min and min-max estimators, and can be easily adapted to other common monotone models including, for example, (i) monotone density estimation, (ii) interval censoring model with current status data, (iii) counting process model with panel count data, and (iv) generalized linear models. Extensive simulations are carried out to support our theory.