POST-SELECTION INFERENCE VIA ALGORITHMIC STABILITY

• 成果类型: Article
• 署名作者: Zrnic, Tijana; Jordan, Michael I.
• 署名单位: University of California System; University of California Berkeley
• 刊物名称: ANNALS OF STATISTICS
• ISSN/ISSBN: 0090-5364
• DOI: 10.1214/23-AOS2303
• 发表日期: 2023
• 页码: 1666-1691
• 关键词: predictive inference

摘要

When the target of statistical inference is chosen in a data-driven manner, the guarantees provided by classical theories vanish. We propose a solution to the problem of inference after selection by building on the framework of algorithmic stability, in particular its branch with origins in the field of differential privacy. Stability is achieved via randomization of selection and it serves as a quantitative measure that is sufficient to obtain nontrivial post-selection corrections for classical confidence intervals. Importantly, the underpinnings of algorithmic stability translate directly into computational efficiency-our method computes simple corrections for selective inference without recourse to Markov chain Monte Carlo sampling.