SHARP MULTIPLE TESTING BOUNDARY FOR SPARSE SEQUENCES

• 成果类型: Article
• 署名作者: Abraham, Kweku; Castillo, Ismael; Roquain, Etienne
• 署名单位: University of Cambridge; Universite Paris Cite; Sorbonne Universite
• 刊物名称: ANNALS OF STATISTICS
• ISSN/ISSBN: 0090-5364
• DOI: 10.1214/24-AOS2404
• 发表日期: 2024
• 页码: 1564-1591
• 关键词: false discovery rate; empirical bayes analysis; variable selection; HIGHER CRITICISM; unknown sparsity; rates; spike; needles

摘要

This work investigates multiple testing by considering minimax separation rates in the sparse sequence model, when the testing risk is measured as the sum FDR+FNR + FNR (False Discovery Rate plus False Negative Rate). First, using the popular beta-min separation condition, with all nonzero signals separated from 0 by at least some amount, we determine the sharp minimax testing risk asymptotically and thereby explicitly describe the transition from achievable multiple testing with vanishing risk to impossible multiple testing. Adaptive multiple testing procedures achieving the corresponding optimal boundary are provided: the Benjamini-Hochberg procedure with a properly tuned level, and an empirical Bayes & ell;-value ('local FDR') procedure. We prove that the FDR and FNR make nonsymmetric contributions to the testing risk for most optimal procedures, the FNR part being dominant at the boundary. The multiple testing hardness is then investigated for classes of arbitrary sparse signals. A number of extensions, including results for classification losses and convergence rates in the case of large signals, are also investigated.