用头戴式设备摄像头实现裸手皮肤触控，精度高且适应多种环境。
EgoTouch: On-Body Touch Input Using AR/VR Headset Cameras
- 仅用内置RGB摄像头捕捉裸手触碰皮肤的动作
- 在不同光照、肤色和移动状态下保持高精度识别
- 支持力道、手指身份、接触角度等多维输入，适合交互设计者
在增强现实（AR）与虚拟现实（VR）体验中，用户的手臂和手部可作为便捷且具触感的输入表面。已有研究显示，与当前普遍使用的空中手势界面相比，体表输入在速度、准确性和人体工学方面具有显著优势。本文展示了一种仅使用现代XR头显中已有的RGB摄像头，即可实现高精度、无需特殊装备的裸手皮肤触控方法。实验结果表明，该方法在不同光照条件、肤色及身体运动（如行走中）下均表现稳健。此外，我们的处理流程还能提供丰富的输入元数据，包括触控力度、手指识别、接触角度和旋转信息。我们认为这些技术要素是充分释放皮肤界面潜力的关键，而这类界面虽在人机交互领域已有广泛研究动机，却长期缺乏可靠且实用的技术方案。
原文摘要 · Abstract (English)
In augmented and virtual reality (AR/VR) experiences, a user's arms and hands can provide a convenient and tactile surface for touch input. Prior work has shown on-body input to have significant speed, accuracy, and ergonomic benefits over in-air interfaces, which are common today. In this work, we demonstrate high accuracy, bare hands (i.e., no special instrumentation of the user) skin input using just an RGB camera, like those already integrated into all modern XR headsets. Our results show this approach can be accurate, and robust across diverse lighting conditions, skin tones, and body motion (e.g., input while walking). Finally, our pipeline also provides rich input metadata including touch force, finger identification, angle of attack, and rotation. We believe these are the requisite technical ingredients to more fully unlock on-skin interfaces that have been well motivated in the HCI literature but have lacked robust and practical methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。