Dual Effect, Certainty Equivalence, and Separation Revisited: A Counterexample and a Relaxed Characterization for Optimality

• 成果类型: Article
• 署名作者: Derpich, Milan S.; Yuksel, Serdar
• 署名单位: Universidad Tecnica Federico Santa Maria; Queens University - Canada
• 刊物名称: IEEE TRANSACTIONS ON AUTOMATIC CONTROL
• ISSN/ISSBN: 0018-9286
• DOI: 10.1109/TAC.2022.3151189
• 发表日期: 2023
• 页码: 1259-1266
• 关键词: Optimal control; Time measurement; PROCESS CONTROL; Noise measurement; Stochastic processes; estimation; Aerospace electronics; Stochastic systems; optimal control

摘要

In this article, we study the optimality of control policies admitting certainty equivalence or separation (of estimation and control) in discrete-time stochastic control, with the following two main contributions. We first revisit the influential theorem given in the seminal 1974 paper by Bar-Shalom and Tse, which studies the equivalence between certainty equivalence (CE) and no-dual-effect (NDE) properties in discrete-time stochastic control problems involving a linear dynamic system with a possibly nonlinear measurement function. We show that there is a subtle error in Bar-Shalom and Tse's proof of the claim that CE implies NDE. Moreover, we prove that the claim does not hold by providing a counterexample. As our second and primary contribution, we introduce an alternative and a more relaxed notion of dual freeness and establish that this new notion is sufficient to guarantee the separation of estimation and control and CE in the same control problem considered by Bar-Shalom and Tse.