-
作者：Chang, Hyeong Soo
作者单位：Sogang University
摘要：This note revisits the rolling-horizon control approach to the problem of Markov decision process (MDP) with infinite-horizon discounted expected reward criterion. Distinguished from the classical value-iteration approaches, we develop an asynchronous online algorithm based on policy iteration integrated with a multipolicy improvement method of policy switching. A sequence of monotonically improving solutions to the forecast-horizon sub-MDP is generated by updating the current solution only at...
-
作者：Liu, Kun-Zhi; Teel, Andrew R.; Sun, Xi-Ming
作者单位：Dalian University of Technology; University of California System; University of California Santa Barbara
摘要：In this article, the stability problem for event-triggered nonlinear control systems is addressed in the presence of stochastic denial of service attacks on the communication network. Dynamic event-triggered control and periodic event-triggered control are considered under the stochastic attacks. The stochastic attacks are modeled by a stochastic hybrid timer and a logic variable which is used to identify whether the network is attacked or not. Then, the entire closed-loop system can be modele...
-
作者：Liu, Jie; Ho, Daniel W. C.; Li, Lulu
作者单位：City University of Hong Kong; Hefei University of Technology
摘要：In this article, we study the distributed optimization problem (DOP) over the time-varying communication network topology with communication delays. The existing distributed optimization algorithms (DOAs) cannot be directly applied to DOPs over the time-varying network with communication delays. In this article, by adding new virtual agents and redefining communication links, some delay properties are realized and existing DOAs can then be reused to solve the DOPs. Thus, a generic algorithm fr...
-
作者：Ramos, Guilherme; Silvestre, Daniel; Silvestre, Carlos
作者单位：Universidade de Lisboa; Instituto de Telecomunicacoes; Universidade Nova de Lisboa; Universidade de Lisboa; Universidade de Coimbra; Universidade de Lisboa; University of Macau; Universidade de Lisboa
摘要：We tackle the problem of a set of agents achieving resilient consensus in the presence of attacked agents. We present a discrete-time reputation-based consensus algorithm for synchronous and asynchronous networks by developing a local strategy where, at each time, each agent assigns a reputation (between zero and one) to each neighbor. The reputation is then used to weigh the neighbors' values in the update of its state. Under mild assumptions, we show that: 1) the proposed method converges ex...
-
作者：Liu, Yuxuan; Ye, Maojiao; Ding, Lei; Xie, Lihua; Xu, Shengyuan
作者单位：Nanjing University of Science & Technology; Nanjing University of Posts & Telecommunications; Nanjing University of Posts & Telecommunications; Nanjing University of Posts & Telecommunications; Nanyang Technological University
摘要：This article considers the problem of online resource allocation in an open network where the engaged agents are allowed to join and leave freely. To deal with network openness, each agent possesses two auxiliary variables, utilized to store the sum of gradients and record the number of stored gradients, respectively. Based on the stored information and primal-dual techniques, a distributed online optimization algorithm is constructed for agents to achieve the minimization of their total cost ...
-
作者：Moon, Jun; Basar, Tamer
作者单位：Hanyang University; University of Illinois System; University of Illinois Urbana-Champaign
摘要：We consider the partially observed linear-quadratic (LQ) optimal control problem for mean-field type stochastic systems driven by Brownian motion. The control does not have access to complete state information, but only to noisy state information from the (stochastic) observation model. The dynamics and observation model as well as the objective functional include the expected values of state and control variables, known as the mean-field variables. The main result is the separation between op...
-
作者：Zhu, Bohao; Lam, James; Shen, Jun; Cui, Yukang; Lu, Xiujuan; Kwok, Ka-Wai
作者单位：University of Hong Kong; Nanjing University of Aeronautics & Astronautics; Shenzhen University; Chinese University of Hong Kong
摘要：This article investigates the input-output gain of linear discrete-time cone-preserving systems. The cone linear absolute-norm and cone max-norm, which are applied to describe input-output gains of cone-preserving systems, are introduced. Subsequently, by utilizing the property of cone-preserving systems, several necessary and sufficient conditions to characterize input-output gains of the system in terms of cone-induced norms are provided. The results indicate that input-output gains of cone-...
-
作者：Deng, Zhenhua; Chen, Tao
作者单位：Central South University
摘要：This article investigates multicluster games (MCGs) of multiagent systems, where the players are subject to nonlinear inequality constraints. In contrast to existing MCGs, our problem involves the second-order nonlinear dynamics of players. Due to the second-order nonlinear dynamics, existing Nash equilibrium (NE) seeking algorithms cannot deal with our problem. Also, the second-order nonlinear dynamics and the nonlinear inequality constraints make it difficult to design and analyze distribute...
-
作者：Kennedy, Justin M.; Ford, Jason J.; Quevedo, Daniel E.; Dressler, Falko
作者单位：Queensland University of Technology (QUT); Technical University of Berlin
摘要：Secrecy encoding for remote state estimation in the presence of adversarial eavesdroppers is a well studied problem. Typical existing secrecy encoding schemes rely on the transmitter's knowledge of the remote estimator's current performance. This performance measure is often shared via packet receipt acknowledgments. However, in practical situations the acknowledgment channel may be susceptible to interference from an active adversary, resulting in the secrecy encoding scheme failing. Aiming t...
-
作者：Koru, Ahmet Taha; Sarsilmaz, Selahattin Burak; Kartal, Yusuf; Lewis, Frank L.; Yucelen, Tansel; Muse, Jonathan A.; Davoudi, Ali
作者单位：University of Texas System; University of Texas Arlington; Utah System of Higher Education; Utah State University; State University System of Florida; University of South Florida
摘要：This article considers the cooperative output regulation problem of heterogeneous linear time-invariant multiagent systems over switching graphs. A sufficient condition for an internal model-based distributed dynamic state feedback control law to solve this problem is the asymptotic stability of the origin of the unforced switched closed-loop system under graph-theoretic and algebraic assumptions. Notably, the asymptotic stability depends on the properties of the switching signal. To this end,...
