The role of fibration symmetries in geometric deep learning

• 成果类型: Article
• 署名作者: Velarde, Osvaldo M.; Parra, Lucas C.; Boldi, Paolo; Makse, Hernan A.
• 署名单位: City University of New York (CUNY) System; City College of New York (CUNY); University of Milan; City University of New York (CUNY) System; City College of New York (CUNY)
• 刊物名称: PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
• ISSN/ISSBN: 0027-8424; 1091-6490
• DOI: 10.1073/pnas.2416552123
• 发表日期: 2026-01-27
• 页码: e2416552123
• 关键词: Deep Neural Networks; graph symmetries; Network dynamics; fibration symmetries; networks

摘要

Geometric Deep Learning (GDL) unifies a broad class of machine learning techniques from the perspectives of symmetries, offering a framework for introducing problem specific inductive biases like Graph Neural Networks (GNNs). However, the current formulation of GDL is limited to global symmetries. We propose to relax GDL to allow for local symmetries, specifically fibration symmetries, which only require isomorphic input trees-a property that is much more common in real-world graphs. We show that GNNs apply the inductive bias of fibration symmetries and derive a tighter upper bound for their expressive power. Additionally, by identifying symmetries in networks, we compress network nodes, thereby increasing their computational efficiency during both inference and training of deep neural networks. The mathematical extension introduced here applies beyond graphs to manifolds, bundles, and grids for the development models with inductive biases induced by local symmetries that can lead to better generalization.