Image segmentation with traveling waves in an exactly solvable recurrent neural network

成果类型:
Article
署名作者:
Liboni, Luisa H. B.; Budzinski, Roberto C.; Busch, Alexandra N.; Lowe, Sindy; Keller, Thomas A.; Welling, Max; Muller, Lyle E.
署名单位:
Western University (University of Western Ontario); Western University (University of Western Ontario); Western University (University of Western Ontario); University of Amsterdam; University of Amsterdam
刊物名称:
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
ISSN/ISSBN:
0027-14113
DOI:
10.1073/pnas.2321319121
发表日期:
2025-01-07
关键词:
摘要:
We study image segmentation using spatiotemporal dynamics in a recurrent neural network where the state of each unit is given by a complex number. We show that this network generates sophisticated spatiotemporal dynamics that can effectively divide an image into groups according to a scene's structural characteristics. We then demonstrate a simple algorithm for object segmentation that generalizes across inputs ranging from simple geometric objects in grayscale images to natural images. Using an exact solution of the recurrent network's dynamics, we present a precise description of the mechanism underlying object segmentation in the network dynamics, providing a clear mathematical interpretation of how the algorithm performs this task. Object segmentation across all images is accomplished with one recurrent neural network that has a single, fixed set of weights. This demonstrates the expressive potential of recurrent neural networks when constructed using a mathematical approach that brings together their structure, dynamics, and computation.