Data-Driven Ranking and Selection Under Input Uncertainty

• 成果类型: Article
• 署名作者: Wu, Di; Wang, Yuhao; Zhou, Enlu
• 署名单位: Amazon.com; University System of Georgia; Georgia Institute of Technology
• 刊物名称: OPERATIONS RESEARCH
• ISSN/ISSBN: 0030-364X
• DOI: 10.1287/opre.2022.2375
• 发表日期: 2024
• 关键词: quantifying uncertainty; simulation experiments; multiarmed bandit; elimination; designs

摘要

We consider a simulation-based ranking and selection (R&S) problem with input uncertainty, in which unknown input distributions can be estimated using input data arriving in batches of varying sizes over time. Each time a batch arrives, additional simulations can be run using updated input distribution estimates. The goal is to confi- dently identify the best design after collecting as few batches as possible. We first introduce a moving average estimator for aggregating simulation outputs generated under heterogenous input distributions. Then, based on a sequential elimination framework, we devise two major R&S procedures by establishing exact and asymptotic confidence bands for the estimator. We also extend our procedures to the indifference zone setting, which helps save simulation effort for practical usage. Numerical results show the effectiveness and necessity of our procedures in controlling error from input uncertainty. Moreover, the effi- ciency can be further boosted through optimizing the drop rate parameter, which is the proportion of past simulation outputs to discard, of the moving average estimator.