Online Learning and Optimization for Queues with Unknown Arrival Rate and Service Distribution

• 成果类型: Article
• 署名作者: Chen, Xinyun; Hong, Guiyu; Liu, Yunan
• 署名单位: The Chinese University of Hong Kong, Shenzhen; Shanghai University of Finance & Economics; Amazon.com; North Carolina State University
• 刊物名称: OPERATIONS RESEARCH
• ISSN/ISSBN: 0030-364X
• DOI: 10.1287/opre.2023.0304
• 发表日期: 2026
• 关键词: stochastic optimization; gi/g/1 queue; CONVERGENCE; algorithm; simulation; RESOURCES; systems

摘要

We investigate an optimization problem in a queueing system where the service provider selects the optimal service fee p and service capacity & micro; to maximize the cumulative expected profit (the service revenue minus the capacity cost and delay penalty). The conventional predict-then-optimize (PTO) approach takes two steps: First, it estimates the model parameters (e.g., arrival rate and service-time distribution) from data; second, it optimizes a model taking these parameters as input. A major drawback of PTO is that its solution accuracy can often be highly sensitive to the parameter estimation errors because PTO is unable to effectively account for how these errors (Step 1) will impact the solution quality of the downstream optimization (Step 2). To remedy this issue, we develop an online learning framework that automatically incorporates the aforementioned parameter estimation errors in the optimization process; it is an end-to-end approach that can learn the optimal solution without needing to set up the parameter estimation as a separate step as in PTO. Effectiveness of our online learning approach is substantiated by (i) theoretical results including the algorithm convergence and analysis of the regret (cost to pay over time for the algorithm to learn the optimal policy) and (ii) engineering confirmation via simulation experiments of a variety of representative examples. We also provide careful comparisons between PTO and our online learning method.