Gradient-Tracking-Based Distributed Optimization With Guaranteed Optimality Under Noisy Information Sharing

• 成果类型: Article
• 署名作者: Wang, Yongqiang; Basar, Tamer
• 署名单位: Clemson University; University of Illinois System; University of Illinois Urbana-Champaign
• 刊物名称: IEEE TRANSACTIONS ON AUTOMATIC CONTROL
• ISSN/ISSBN: 0018-9286
• DOI: 10.1109/TAC.2022.3212006
• 发表日期: 2023
• 页码: 4796-4811
• 关键词: Distributed optimization; gradient tracking; information-sharing noise; stochastic gradient methods

摘要

Distributed optimization enables networked agents to cooperatively solve a global optimization problem. Despite making significant inroads, most existing results on distributed optimization rely on noise-free information sharing among the agents, which is problematic when communication channels are noisy, messages are coarsely quantized, or shared information are obscured by additive noise for the purpose of achieving differential privacy. The problem of information-sharing noise is particularly pronounced in the state-of-the-art gradient-tracking-based distributed optimization algorithms, in that information-sharing noise will accumulate with iterations on the gradient-tracking estimate of these algorithms, and the ensuing variance will even grow unbounded when the noise is persistent. This article proposes a new gradient-tracking-based distributed optimization approach that can avoid information-sharing noise from accumulating in the gradient estimation. The approach is applicable even when the interagent interaction is time-varying, which is key to enable the incorporation of a decaying factor in interagent interaction to gradually eliminate the influence of information-sharing noise. In fact, we rigorously prove that the proposed approach can ensure the almost sure convergence of all agents to the same optimal solution even in the presence of persistent information-sharing noise. The approach is applicable to general directed graphs. It is also capable of ensuring the almost sure convergence of all agents to an optimal solution when the gradients are noisy, which is common in machine learning applications. Numerical simulations confirm the effectiveness of the proposed approach.