Full-colour 3D holographic augmented-reality displays with metasurface waveguides

• 成果类型: Article
• 署名作者: Gopakumar, Manu; Lee, Gun-Yeal; Choi, Suyeon; Chao, Brian; Peng, Yifan; Kim, Jonghyun; Wetzstein, Gordon
• 署名单位: Stanford University; University of Hong Kong; Nvidia Corporation
• 刊物名称: Nature
• ISSN/ISSBN: 0028-5703
• DOI: 10.1038/s41586-024-07386-0
• 发表日期: 2024-05-23
• 页码: 791-797
• 关键词: design; optics

摘要

Emerging spatial computing systems seamlessly superimpose digital information on the physical environment observed by a user, enabling transformative experiences across various domains, such as entertainment, education, communication and training(1-3). However, the widespread adoption of augmented-reality (AR) displays has been limited due to the bulky projection optics of their light engines and their inability to accurately portray three-dimensional (3D) depth cues for virtual content, among other factors(4,5). Here we introduce a holographic AR system that overcomes these challenges using a unique combination of inverse-designed full-colour metasurface gratings, a compact dispersion-compensating waveguide geometry and artificial-intelligence-driven holography algorithms. These elements are co-designed to eliminate the need for bulky collimation optics between the spatial light modulator and the waveguide and to present vibrant, full-colour, 3D AR content in a compact device form factor. To deliver unprecedented visual quality with our prototype, we develop an innovative image formation model that combines a physically accurate waveguide model with learned components that are automatically calibrated using camera feedback. Our unique co-design of a nanophotonic metasurface waveguide and artificial-intelligence-driven holographic algorithms represents a significant advancement in creating visually compelling 3D AR experiences in a compact wearable device.