Sequential Learning with a Similarity Selection Index

• 成果类型: Article
• 署名作者: Zhou, Yi; Fu, Michael C.; Ryzhov, Ilya O.
• 署名单位: University System of Maryland; University of Maryland College Park; University System of Maryland; University of Maryland College Park; University System of Maryland; University of Maryland College Park
• 刊物名称: OPERATIONS RESEARCH
• ISSN/ISSBN: 0030-364X
• DOI: 10.1287/opre.2023.2478
• 发表日期: 2024
• 页码: 2526-2542
• 关键词: simulation budget allocation; knowledge-gradient

摘要

We consider the problem of selecting the best alternative in a setting where prior similarity information between the performance output of different alternatives can be learned from data. Incorporating similarity information enables efficient budget allocation for faster identification of the best alternative in sequential selection. Using a new selection criterion, the similarity selection index, we develop two new allocation methods: one based on a mathematical programming characterization of the asymptotically optimal budget allocation and the other based on a myopic expected improvement measure. For the former, we present a novel sequential implementation that provably learns the optimal allocation without tuning. For the latter, we derive its asymptotic sampling ratios. We also propose a practical way to update the prior similarity information as new samples are collected. Numerical results illustrate the effectiveness of both methods.