A generalized Dantzig selector with shrinkage tuning

• 成果类型: Article
• 署名作者: James, Gareth M.; Radchenko, Peter
• 署名单位: University of Southern California
• 刊物名称: BIOMETRIKA
• ISSN/ISSBN: 0006-3444
• DOI: 10.1093/biomet/asp013
• 发表日期: 2009
• 页码: 323337
• 关键词: statistical estimation; variable selection; algorithm; larger

摘要

The Dantzig selector performs variable selection and model fitting in linear regression. It uses an L-1 penalty to shrink the regression coefficients towards zero, in a similar fashion to the lasso. While both the lasso and Dantzig selector potentially do a good job of selecting the correct variables, they tend to overshrink the final coefficients. This results in an unfortunate trade-off. One can either select a high shrinkage tuning parameter that produces an accurate model but poor coefficient estimates or a low shrinkage parameter that produces more accurate coefficients but includes many irrelevant variables. We extend the Dantzig selector to fit generalized linear models while eliminating overshrinkage of the coefficient estimates, and develop a computationally efficient algorithm, similar in nature to least angle regression, to compute the entire path of coefficient estimates. A simulation study illustrates the advantages of our approach relative to others. We apply the methodology to two datasets.