Discovering cognitive strategies with tiny recurrent neural networks

• 成果类型: Article
• 署名作者: Li, Ji-An; Benna, Marcus K.; Mattar, Marcelo G.
• 署名单位: University of California System; University of California San Diego; New York University; New York University
• 刊物名称: Nature
• ISSN/ISSBN: 0028-1510
• DOI: 10.1038/s41586-025-09142-4
• 发表日期: 2025-08-28
• 关键词: information; DYNAMICS; models; memory

摘要

Understanding how animals and humans learn from experience to make adaptive decisions is a fundamental goal of neuroscience and psychology. Normative modelling frameworks such as Bayesian inference1 and reinforcement learning2 provide valuable insights into the principles governing adaptive behaviour. However, the simplicity of these frameworks often limits their ability to capture realistic biological behaviour, leading to cycles of handcrafted adjustments that are prone to researcher subjectivity. Here we present a novel modelling approach that leverages recurrent neural networks to discover the cognitive algorithms governing biological decision-making. We show that neural networks with just one to four units often outperform classical cognitive models and match larger neural networks in predicting the choices of individual animals and humans, across six well-studied reward-learning tasks. Critically, we can interpret the trained networks using dynamical systems concepts, enabling a unified comparison of cognitive models and revealing detailed mechanisms underlying choice behaviour. Our approach also estimates the dimensionality of behaviour3 and offers insights into algorithms learned by meta-reinforcement learning artificial intelligence agents. Overall, we present a systematic approach for discovering interpretable cognitive strategies in decision-making, offering insights into neural mechanisms and a foundation for studying healthy and dysfunctional cognition.