Doubly Robust Augmented Model Accuracy Transfer Inference with High Dimensional Features

• 成果类型: Article
• 署名作者: Zhou, Doudou; Liu, Molei; Li, Mengyan; Cai, Tianxi
• 署名单位: Harvard University; Harvard T.H. Chan School of Public Health; National University of Singapore; Columbia University; Bentley University; Harvard University; Harvard Medical School
• 刊物名称: JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION
• ISSN/ISSBN: 0162-1459
• DOI: 10.1080/01621459.2024.2356291
• 发表日期: 2025
• 页码: 524-534
• 关键词: LINEAR-REGRESSION; risk prediction; ROC curve; AREA; efficient; biobank; HEALTH

摘要

Transfer learning is crucial for training models that generalize to unlabeled target populations using labeled source data, especially in real-world studies where label scarcity and covariate shift are common. While most research focuses on model estimation, there is limited literature on transfer inference for model accuracy despite its importance. We introduce a novel Doubly Robust Augmented Model Accuracy Transfer Inferen Ce (DRAMATIC) method for point and interval estimation of commonly used classification performance measures in an unlabeled target population with labeled source data. DRAMATIC derives and evaluates a potentially misspecified risk model for a binary response, leveraging high-dimensional adjustment features from both source and target data. It builds on an imputation model for the response mean and a density ratio model to characterize distributional shifts. The method constructs doubly robust estimators that are valid when either model is correctly specified and certain sparsity assumptions hold. Simulations show negligible bias in point estimation and satisfactory empirical coverage levels in confidence intervals. The utility of DRAMATIC is illustrated by transferring a genetic risk prediction model and its accuracy evaluation for type II diabetes across two patient cohorts in Mass General Brigham (MGB). Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.