Innovation Compression for Communication-Efficient Distributed Optimization With Linear Convergence

• 成果类型: Article
• 署名作者: Zhang, Jiaqi; You, Keyou; Xie, Lihua
• 署名单位: Tsinghua University; Nanyang Technological University
• 刊物名称: IEEE TRANSACTIONS ON AUTOMATIC CONTROL
• ISSN/ISSBN: 0018-9286
• DOI: 10.1109/TAC.2023.3241771
• 发表日期: 2023
• 页码: 6899-6906
• 关键词: compression; distributed optimization; INNOVATION; linear convergence.

摘要

Information compression is essential to reduce communication cost in distributed optimization over peer-to-peer networks. This article proposes a communication-efficient linearly convergent distributed (COLD) algorithm to solve strongly convex optimization problems. By compressing innovation vectors, which are the differences between decision vectors and their estimates, COLD achieves linear convergence for a class of delta-contracted compressors, and we explicitly quantify how the compression affects the convergence rate. Interestingly, our results strictly improve existing results for the quantized consensus problem. Numerical experiments demonstrate the advantages of COLD under different compressors.