arXiv:2502.14939cs.CVcs.AI2025-02被引 1

用图注意力网络实现实时手部手势连续识别,适应动态环境变化。

Online hand gesture recognition using Continual Graph Transformers

  • 结合空间图卷积与变压器图编码器,捕捉骨架序列时空特征。
  • 在SHREC'21数据集上达到当前最优准确率,误报率显著降低。
  • 支持持续学习,适合人机交互、辅助技术等实时场景。

在线连续动作识别因其在人机交互、医疗健康和机器人领域的实际应用价值而成为关键研究方向。基于骨架的方法因其能有效捕捉三维时间数据并具备环境鲁棒性而备受关注,但多数现有方法聚焦于分段识别,难以满足实时连续场景需求。本文提出一种面向实时骨架序列流的在线识别系统,采用S-GCN提取空间特征,TGE捕捉跨帧时间依赖关系,并引入持续学习机制以增强模型对数据分布演化的适应能力。在SHREC'21基准数据集上的实验表明,该方法不仅实现领先性能,且显著降低误报率。系统可无缝集成至人机协作与辅助技术等领域,为自然直观交互提供有力支持。

原文摘要 · Abstract (English)

Online continuous action recognition has emerged as a critical research area due to its practical implications in real-world applications, such as human-computer interaction, healthcare, and robotics. Among various modalities, skeleton-based approaches have gained significant popularity, demonstrating their effectiveness in capturing 3D temporal data while ensuring robustness to environmental variations. However, most existing works focus on segment-based recognition, making them unsuitable for real-time, continuous recognition scenarios. In this paper, we propose a novel online recognition system designed for real-time skeleton sequence streaming. Our approach leverages a hybrid architecture combining Spatial Graph Convolutional Networks (S-GCN) for spatial feature extraction and a Transformer-based Graph Encoder (TGE) for capturing temporal dependencies across frames. Additionally, we introduce a continual learning mechanism to enhance model adaptability to evolving data distributions, ensuring robust recognition in dynamic environments. We evaluate our method on the SHREC'21 benchmark dataset, demonstrating its superior performance in online hand gesture recognition. Our approach not only achieves state-of-the-art accuracy but also significantly reduces false positive rates, making it a compelling solution for real-time applications. The proposed system can be seamlessly integrated into various domains, including human-robot collaboration and assistive technologies, where natural and intuitive interaction is crucial.

手势识别图神经网络持续学习实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。