Uniform post-selection inference for least absolute deviation regression and other Z-estimation problems

• 成果类型: Article
• 署名作者: Belloni, A.; Chernozhukov, V.; Kato, K.
• 署名单位: Duke University; Massachusetts Institute of Technology (MIT); University of Tokyo
• 刊物名称: BIOMETRIKA
• ISSN/ISSBN: 0006-3444
• DOI: 10.1093/biomet/asu056
• 发表日期: 2015
• 页码: 7794
• 关键词: ASYMPTOTIC-BEHAVIOR; quantile regression; parameters; models; Lasso; p2/n

摘要

We develop uniformly valid confidence regions for regression coefficients in a high-dimensional sparse median regression model with homoscedastic errors. Our methods are based on a moment equation that is immunized against nonregular estimation of the nuisance part of the median regression function by using Neyman's orthogonalization. We establish that the resulting instrumental median regression estimator of a target regression coefficient is asymptotically normally distributed uniformly with respect to the underlying sparse model and is semiparametrically efficient. We also generalize our method to a general nonsmooth Z-estimation framework where the number of target parameters is possibly much larger than the sample size. We extend Huber's results on asymptotic normality to this setting, demonstrating uniform asymptotic normality of the proposed estimators over rectangles, constructing simultaneous confidence bands on all of the target parameters, and establishing asymptotic validity of the bands uniformly over underlying approximately sparse models.