arXiv:2503.00676cs.RO2025-03被引 1

仅需一次演示即可识别水下手势,无需训练

One-Shot Gesture Recognition for Underwater Diver-To-Robot Communication

  • 基于形状特征实现单次演示手势识别
  • 在真实水下数据上达到高准确率,适合嵌入式设备
  • 比深度学习方法更轻量、更易适应新手势

可靠的水下人机交互(U-HRI)依赖于稳定的人机通信。传统方法如声学信号和预设手势模型在适应性和鲁棒性方面存在局限。本文提出一种一次性手势识别(OSG)方法,通过单次演示实现实时、基于姿态的时序手势识别,无需大量数据集或模型重训练。OSG利用基于形状的分类技术,包括Hu矩、Zernike矩和傅里叶描述符,在视觉挑战性强的水下环境中实现稳健识别。系统在真实水下数据上表现优异,并可在自主水下航行器(AUV)常见的嵌入式硬件上高效运行,具备部署可行性。相比深度学习方法,OSG轻量化、计算效率高且高度可适应,适用于潜水员与机器人之间的通信。我们在增强手势数据集和真实水下视频数据上评估了OSG性能,并与深度学习方法对比,结果表明其能实现用户自定义手势的即时部署,突破预设手势语言的限制。

原文摘要 · Abstract (English)

Reliable human-robot communication is essential for underwater human-robot interaction (U-HRI), yet traditional methods such as acoustic signaling and predefined gesture-based models suffer from limitations in adaptability and robustness. In this work, we propose One-Shot Gesture Recognition (OSG), a novel method that enables real-time, pose-based, temporal gesture recognition underwater from a single demonstration, eliminating the need for extensive dataset collection or model retraining. OSG leverages shape-based classification techniques, including Hu moments, Zernike moments, and Fourier descriptors, to robustly recognize gestures in visually-challenging underwater environments. Our system achieves high accuracy on real-world underwater data and operates efficiently on embedded hardware commonly found on autonomous underwater vehicles (AUVs), demonstrating its feasibility for deployment on-board robots. Compared to deep learning approaches, OSG is lightweight, computationally efficient, and highly adaptable, making it ideal for diver-to-robot communication. We evaluate OSG's performance on an augmented gesture dataset and real-world underwater video data, comparing its accuracy against deep learning methods. Our results show OSG's potential to enhance U-HRI by enabling the immediate deployment of user-defined gestures without the constraints of predefined gesture languages.

手势识别水下通信轻量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。