A generic non-invasive neuromotor interface for human-computer interaction

• 成果类型: Article
• 署名作者: Kaifosh, Patrick; Reardon, Thomas R.; Allen, Brian D.; Anderson, Chris; Arnoud, Sacha; Arora, Rahul; Atray, Mridu; Awad, Lana; Ayerbe, Francisco; Baker, Christopher; Baker, Nicholas; Barachant, Alexandre; Bard, Philip; Beltran, Wilman Pimentel; Berenzweig, Adam; Bhasin, Rohin; Bienkowski, Joe; Bittner, Sean; Boegner, Luke; Bolarinwa, Anu; Bosley, Don; Bracaglia, Matthew; Braecklein, Mario; Brandwein, Maclyn; Bravate, Joe; Butler, Matt; Calhoun, Adam J.; Chang, Chia-Jung; Chenet, Daniel; Chester, Joshua; Chiarito, Rudi; Chitnis, Rohan; Choi, John; Chun, Won; Chung, Jeremiah; Connors, James; Costa, Jota; Cramer, Mark; Cunningham, Raven; Cusack, William F.; Danielson, Nathan; Davidson, Thomas J.; De Araujo, Bruno; Dimaiolo, Bob; Draves, Scott; Du, Alan; Edelson, Zaina; Enemuo, Phina; Fahmi, Mina; Farsad, Nariman; Farshchian, Ali; Feliz, Randy; Fine, Jake; Formento, Emanuele; Freeman, Dustin; Fu, Jianing; Gagnon-Audet, Jean-Christophe; Gajurel, Rupesh; Gamutan, Jonathan; Gao, Sida; Garcia, Jonateal; Gayraud, Nathalie Therese Helene; Ghani, Minha; Ghosh, Sayan; Gidwani, Vickram; Giebisch, Danny; Gimler, Greg; Gramfort, Alexandre; Grosberg, Lauren; Gunther, Bryn; Guo, Ning; Gupta, Chetan; Kaya, Sinem Guven; Ha, Austin; Hadjer, Katarina; Hernandez, Carlos Xavier; Hertz, Stav; Hewitt, Carl; Hill, Daniel N.; Hong, Kirak; Hong, Lillian; Hou, Helen; Hruda, Stepan; Hsieh, Alex; Hsiung, Vivian; Huang, Rongqing; Hui, Yue; Hulet, Hazel; Islam, Shaker; Jayaram, Vinay; Jiang, Connie; Jiang, Xiaodong; Juarez, Brooke; Jun, James Jaeyoon; Jun, Na Young; Kadakia, Nirag; Kakar, Nishant; Kamdar, Ajay; Kao, Ta-Chu; Kober, Steven; Koh, Tw; Koshy, Christina Shabu; Lawn, Andrzej; Lee, Claire; Lee, Jennifer; Lee, Jinhyung; Lee, Juheui Amy; Li, Tiffanie; Liao, Jonathan; Liu, Yingru; Liu, Yuxuan; Lively, Saar; London, Kati; Louie, Roddy; Luongo, Francisco; Maczak, Attila; Maheswaranathan, Niru; Mandel, Michael; Marshall, Jesse; Marshall, Najja; Martincik, Mirek; Masse, Nicolas Yvan; McAnearney, Stephen; McHugh, Ashley; Menendez, Jorge Aurelio; Merel, Josh; Miller, David; Milyavskiy, Ilya; Monti, Ricardo Pio; Moore, Sean; Morin, Yonathan; Morrell, Brock; Morrison, Dano; Moschella, Anthony; Mulumudi, Suman; Muth, Conner; Naik, Krunal; Nakagaki, Norris; Nathan, Ajay; Nelson, Romario; Ngeo, Jimson; Nguyen, Keven; O'Connor, Luke; Ohayon, Shay; Orchard, Garrick; Osborn, Chris; Otchy, Timothy M.; Owolabi, Emmanuella; Packer, Adam M.; Pailla, Tejaswy; Paredes, Julia; Parker, Sean; Peixoto, Diogo; Perez, Matias; Perez, Zavion; Pierard, Adrien; Plaza, Stephen M.; Plotkin, Natalie; Pnevmatikakis, Eftychios; Pool, Brandon; Puri, Shanil; Rajani, Sunaina; Fuentes, Jose Ramirez; Rojas, Julian Ramos; Ranjan, Tanvi; Reardon, Devin; Reid, Jonathan; Reisman, Jason; Rivera, Lain Warawao Nemo Mora y; Rolotti, Sebi; Rosenkranz, Andrew; Roth, Ian; Roy, Likhon; Rubin, Ran; Rudnicki, Alexander; Russell, Sam; Russo, Abby; Sacra, James; Sadoughi, Amir; Salim, Roxanna; Savane, Aichatou; Schlager, Collin; Schwab, David; Seely, Jeffrey; Seltzer, Mike; Sergin, Nurettin Dorukhan; Shah, Ami; Shah, Anish; Shamash, Philip; Sharma, Vandita; Shen, Stephie; Shi, Kevin; Shiah, Olivia; Siahpoosh, Yasmin; Siddiqi, Noor; Simpson, Jeremy; Singh, Gagandip; Sivakumar, Viswanath; Smith, Jeff; Sofuoglu, Seyyid Emre; Song, Ivy Jiyoung; Springer, Morgan; Spurr, Adrian; Stefanini, Fabio; Stout, Connor; Strauss, Emanuel; Suresh, Swetha; Suri, Ananya; Sussillo, David; Tang, Ziyi; Tank, Vikram; Tannady, Jesslyn; Tapia, Aliqyan; Tasci, Tugce; Tesileanu, Tiberiu; Tiwari, Aman; Tiwari, Anoushka; Tong, Calvin; Tormis, Blizelle; Trabulsi, Julia; Tsering, Migmar; Urquhart, Kyle; Walkington, Peter; Wang, Megan; Wang, Renxiong; Wang, Zhuo; Warden, Christy; Warren, Richard; Warriner, Claire L.; Weiss, Ron J.; Wetmore, Daniel Z.; White, Ezri; Wiebe, Christopher; Williams, Steve; Xing, Yuguan; Ye, Chris; Yembarwar, Akshay; Yuan, Shuibenyang; Zawadzki, Michael; Zhang, Mingrui; Zhao, Jiesi; Zheng, Kevin; Zhong, Joseph; Zhou, Lei; Zlobinsky, Danny
• 刊物名称: Nature
• ISSN/ISSBN: 0028-3185
• DOI: 10.1038/s41586-025-09255-w
• 发表日期: 2025-09-18
• 关键词: surface emg; RECOGNITION; INFORMATION; algorithm; hand

摘要

Since the advent of computing, humans have sought computer input technologies that are expressive, intuitive and universal. While diverse modalities have been developed, including keyboards, mice and touchscreens, they require interaction with a device that can be limiting, especially in on-the-go scenarios. Gesture-based systems use cameras or inertial sensors to avoid an intermediary device, but tend to perform well only for unobscured movements. By contrast, brain-computer or neuromotor interfaces that directly interface with the body's electrical signalling have been imagined to solve the interface problem1, but high-bandwidth communication has been demonstrated only using invasive interfaces with bespoke decoders designed for single individuals2, 3-4. Here, we describe the development of a generic non-invasive neuromotor interface that enables computer input decoded from surface electromyography (sEMG). We developed a highly sensitive, easily donned sEMG wristband and a scalable infrastructure for collecting training data from thousands of consenting participants. Together, these data enabled us to develop generic sEMG decoding models that generalize across people. Test users demonstrate a closed-loop median performance of gesture decoding of 0.66 target acquisitions per second in a continuous navigation task, 0.88 gesture detections per second in a discrete-gesture task and handwriting at 20.9 words per minute. We demonstrate that the decoding performance of handwriting models can be further improved by 16% by personalizing sEMG decoding models. To our knowledge, this is the first high-bandwidth neuromotor interface with performant out-of-the-box generalization across people.