Kernel-based Adaptive Huber Mean Regression with Heavy Tails and Contamination

• 成果类型: Article; Early Access
• 署名作者: Liu, Jiamin; Lian, Heng
• 署名单位: University of Science & Technology Beijing; City University of Hong Kong; Shenzhen Research Institute, City University of Hong Kong; City University of Hong Kong
• 刊物名称: JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION
• ISSN/ISSBN: 0162-1459; 1537-274X
• DOI: 10.1080/01621459.2026.2696486
• 发表日期: 2026-07-31
• 关键词: Adaptive Huber regression; Rademacher Complexity; random features; Source condition; rates

摘要

We consider robust conditional mean learning in the mathematical framework of reproducing kernel Hilbert spaces, assuming the errors can be heavy-tailed and at the same time some responses are subject to arbitrary contamination. Simultaneous robustness to both heavy tails and contamination are of interest. When there is no contamination, we establish rates when the (1+theta) -moment (theta>0) of the error exists, which matches the minimax rate for the least squares regression as soon as theta >= 1 , although the existing upper bounds for the least squares regression usually assume sub-Gaussian or sub-exponential error distribution. The existence of contamination adds an additional term to the bound. We also consider learning using random features, which is a computationally efficient kernel approximation method to relieve the computational burden of kernel-based learning. We show the same rates can be achieved with the number of random features much smaller than the sample size, extending previous results on random features for least squares kernel regression. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.