Empirical Bayes Mean Estimation With Nonparametric Errors Via Order Statistic Regression on Replicated Data

• 成果类型: Article
• 署名作者: Ignatiadis, Nikolaos; Saha, Sujayam; Sun, Dennis L.; Muralidharan, Omkar
• 署名单位: Stanford University; Alphabet Inc.; Google Incorporated; California State University System; California Polytechnic State University San Luis Obispo
• 刊物名称: JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION
• ISSN/ISSBN: 0162-1459
• DOI: 10.1080/01621459.2021.1967164
• 发表日期: 2023
• 页码: 987-999
• 关键词: maximum-likelihood estimator; panel-data; models; inference

摘要

We study empirical Bayes estimation of the effect sizes of N units from K noisy observations on each unit. We show that it is possible to achieve near-Bayes optimal mean squared error, without any assumptions or knowledge about the effect size distribution or the noise. The noise distribution can be heteroscedastic and vary arbitrarily from unit to unit. Our proposal, which we call Aurora, leverages the replication inherent in the K observations per unit and recasts the effect size estimation problem as a general regression problem. Aurora with linear regression provably matches the performance of a wide array of estimators including the sample mean, the trimmed mean, the sample median, as well as James-Stein shrunk versions thereof. Aurora automates effect size estimation for Internet-scale datasets, as we demonstrate on data from a large technology firm.