arXiv:2503.11352cs.ROcs.CV2025-03中稿 · publication at the…被引 1

用不变轨迹描述符提升手部手势识别鲁棒性,不受坐标系变化影响。

Enhancing Hand Palm Motion Gesture Recognition by Eliminating Reference Frame Bias via Frame-Invariant Similarity Measures

  • 提出不变轨迹描述方法,消除坐标系依赖带来的识别偏差。
  • 在新构建的手掌动作数据集上实现92.3%的F1分数,实时验证成功。
  • 适合需要稳定手势识别的机器人协作场景,可嵌入现有系统增强鲁棒性。

机器人识别人类手势可促进自然人机协作。然而,多数手势识别方法依赖特定坐标系,易受工作区布局差异、标定不准等环境变化影响。本文研究了不变轨迹描述符在坐标系变化下的鲁棒手势识别性能。首先构建了一个新型手掌运动(HPM)手势数据集,其动作设计无需依赖特定坐标系或方向线索。随后对比多种不变轨迹描述方法在该数据集上的表现。经离线评估后,选取最优方法开发实时概念验证(PoC),通过手势控制机械臂实时运动。实验表明,系统在真实操作中具备高可靠性,取得92.3%的F1分数。结果证明,不变描述符可作为独立解决方案有效运行;同时,该方法也可集成至现有先进模式识别与学习系统,提升对坐标系变化的鲁棒性。

原文摘要 · Abstract (English)

The ability of robots to recognize human gestures facilitates a natural and accessible human-robot collaboration. However, most work in gesture recognition remains rooted in reference frame-dependent representations. This poses a challenge when reference frames vary due to different work cell layouts, imprecise frame calibrations, or other environmental changes. This paper investigated the use of invariant trajectory descriptors for robust hand palm motion gesture recognition under reference frame changes. First, a novel dataset of recorded Hand Palm Motion (HPM) gestures is introduced. The motion gestures in this dataset were specifically designed to be distinguishable without dependence on specific reference frames or directional cues. Afterwards, multiple invariant trajectory descriptor approaches were benchmarked to assess how their performances generalize to this novel HPM dataset. After this offline benchmarking, the best scoring approach is validated for online recognition by developing a real-time Proof of Concept (PoC). In this PoC, hand palm motion gestures were used to control the real-time movement of a manipulator arm. The PoC demonstrated a high recognition reliability in real-time operation, achieving an $F_1$-score of 92.3%. This work demonstrates the effectiveness of the invariant descriptor approach as a standalone solution. Moreover, we believe that the invariant descriptor approach can also be utilized within other state-of-the-art pattern recognition and learning systems to improve their robustness against reference frame variations.

手势识别机器人协作不变性实时控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。