用普通摄像头实现高精度脑机交互，无需特殊设备
NeuGaze: Reshaping the future BCI
- 仅用30Hz普通摄像头，结合眼动、头部和面部动作实现控制
- 在首人称游戏中击败强敌，性能接近传统输入设备
- 适合行动障碍者使用，成本低且无需复杂校准
传统脑机接口依赖昂贵的脑电图设备或侵入式植入，因设置复杂和精度有限，难以支持复杂的交互。我们提出NeuGaze，一种基于普通30 Hz网络摄像头的新系统，通过融合眼动、头部运动和面部表情，实现直观、实时的控制。该系统只需极少校准，即可完成精确光标导航、通过高效技能轮触发按键，并支持动态游戏交互，例如在第一人称游戏中战胜强大对手。对于行动障碍者，该系统保留了颈部以上功能，无需专用硬件，提供低成本、易获取的替代方案。这一范式拓展了辅助技术与娱乐等应用，重新定义了行动障碍者的交互方式。项目地址：github.com/NeuSpeech/NeuGaze。
原文摘要 · Abstract (English)
Traditional brain-computer interfaces (BCIs), reliant on costly electroencephalography or invasive implants, struggle with complex human-computer interactions due to setup complexity and limited precision. We present NeuGaze, a novel webcam-based system that leverages eye gaze, head movements, and facial expressions to enable intuitive, real-time control using only a standard 30 Hz webcam, often pre-installed in laptops. Requiring minimal calibration, NeuGaze achieves performance comparable to conventional inputs, supporting precise cursor navigation, key triggering via an efficient skill wheel, and dynamic gaming interactions, such as defeating formidable opponents in first-person games. By harnessing preserved neck-up functionalities in motor-impaired individuals, NeuGaze eliminates the need for specialized hardware, offering a low-cost, accessible alternative to BCIs. This paradigm empowers diverse applications, from assistive technology to entertainment, redefining human-computer interaction for motor-impaired users. Project is at \href{https://github.com/NeuSpeech/NeuGaze}{github.com/NeuSpeech/NeuGaze}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。