Safe, Always-Valid Alpha-Investing Rules For Doubly Sequential Online Inference
成果类型:
Article; Early Access
署名作者:
Yao, Zeyu; Sun, Wenguang; Gang, Bowen
署名单位:
Zhejiang University; Zhejiang University; Zhejiang University; Zhejiang University; Fudan University
刊物名称:
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION
ISSN/ISSBN:
0162-1459; 1537-274X
DOI:
10.1080/01621459.2026.2700401
发表日期:
2026-07-31
关键词:
Always-valid p-values
Doubly sequential experiments
e-processes
False selection rate
Safe testing
False Discovery Rate
time-uniform
CLASSIFICATION
摘要:
Dynamic decision-making in rapidly evolving research domains, including marketing, finance, and pharmaceutical development, presents a significant challenge. Researchers frequently confront the need for real-time action within a doubly sequential framework characterized by the continuous influx of high-volume data streams and the intermittent arrival of novel tasks. This calls for the development and implementation of new online inference protocols capable of handling both the continuous processing of incoming information and the efficient allocation of resources to address emerging priorities. We introduce a novel class of Safe and Always-Valid Alpha-investing (SAVA) rules that leverages powerful tools including always valid p-values, e-processes, and online false discovery rate methods. The SAVA algorithm effectively integrates information across all tasks, mitigates the alpha-death problem, and controls the false selection rate (FSR) at all decision points. We validate the efficacy of the SAVA framework through rigorous theoretical analysis and extensive numerical experiments. Our results demonstrate that SAVA not only offers effective control of the FSR but also significantly improves statistical power compared to traditional online testing approaches. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.
来源URL: