让机器人在30米外识别手势,提升残障人士远程操控体验
DiG-Net: Enhancing Human-Robot Interaction through Hyper-Range Dynamic Gesture Recognition in Assistive Robotics
- 设计距离感知网络,融合深度对齐与时空图结构
- 在30米超远距离下实现97.3%手势识别准确率
- 适合居家护理、工业安全等远距离辅助场景
动态手部手势在辅助人机交互中起关键作用,尤其适用于行动不便或远程操作的用户。现有手势识别多局限于短距离,难以满足远距离辅助通信需求。本文提出DiG-Net,首个支持高达30米超远距离的动态手势识别框架,专为辅助机器人设计,以提升可及性与生活质量。所提距离感知手势网络(DiG-Net)结合深度条件变形对齐(DADA)块与时空图模块,有效处理因物理衰减、分辨率下降和手势变化带来的挑战。我们引入辐射度时空深度衰减损失(RSTDAL),显著提升模型在不同距离下的学习能力与鲁棒性。在包含复杂超远距手势的多样化数据集上,模型达到97.3%的识别准确率,优于当前主流方法。DiG-Net能有效解读远距离手势,大幅增强家用医疗、工业安全及远程协助场景中辅助机器人的可用性,实现无障碍、直观的人机交互。
原文摘要 · Abstract (English)
Dynamic hand gestures play a pivotal role in assistive human-robot interaction (HRI), facilitating intuitive, non-verbal communication, particularly for individuals with mobility constraints or those operating robots remotely. Current gesture recognition methods are mostly limited to short-range interactions, reducing their utility in scenarios demanding robust assistive communication from afar. In this paper, we present DiG-Net, the first dynamic gesture recognition framework enabling robust operation at hyper-range distances of up to 30 meters, specifically designed for assistive robotics to enhance accessibility and improve quality of life. Our proposed Distance-aware Gesture Network (DiG-Net) effectively combines Depth-Conditioned Deformable Alignment (DADA) blocks with Spatio-Temporal Graph modules, enabling robust processing and classification of gesture sequences captured under challenging conditions, including significant physical attenuation, reduced resolution, and dynamic gesture variations commonly experienced in real-world assistive environments. We further introduce the Radiometric Spatio-Temporal Depth Attenuation Loss (RSTDAL), shown to enhance learning and strengthen model robustness across varying distances. Our model demonstrates significant performance improvement over state-of-the-art gesture recognition frameworks, achieving a recognition accuracy of 97.3% on a diverse dataset with challenging hyper-range gestures. By effectively interpreting gestures from considerable distances, DiG-Net significantly enhances the usability of assistive robots in home healthcare, industrial safety, and remote assistance scenarios, enabling seamless and intuitive interactions for users regardless of physical limitations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。