用3D手部骨架模型提升手势识别精度与实时性,让人机交互更自然。
Computer Vision-Driven Gesture Recognition: Toward Natural and Intuitive Human-Computer
- 基于3D手部关节建模,构建动态静态手势识别结构。
- 在多种环境下保持高识别准确率与实时响应能力。
- 适合虚拟现实、智能家居等需要自然交互的场景。
本研究探索基于计算机视觉的自然手势识别在人机交互中的应用,旨在通过手势识别技术提升交互的流畅性与自然度。在虚拟现实、增强现实和智能家居等领域,传统输入方式已难以满足用户对交互体验的需求。手势作为直观便捷的交互方式,日益受到关注。本文提出一种基于三维手部骨骼模型的手势识别方法,通过模拟手部关节的三维空间分布,构建简化的手部骨架结构,连接掌部与各指关节,形成动态与静态手势模型,从而显著提升手势识别的准确率与效率。实验结果表明,该方法能有效识别各类手势,并在不同环境下保持高识别准确率与实时响应能力。此外,结合眼动追踪等多模态技术,可进一步提升系统智能化水平,带来更丰富直观的用户体验。未来,随着计算机视觉、深度学习及多模态交互技术的发展,基于手势的自然交互将在更广泛场景中发挥重要作用,推动人机交互的革命性进步。
原文摘要 · Abstract (English)
This study mainly explores the application of natural gesture recognition based on computer vision in human-computer interaction, aiming to improve the fluency and naturalness of human-computer interaction through gesture recognition technology. In the fields of virtual reality, augmented reality and smart home, traditional input methods have gradually failed to meet the needs of users for interactive experience. As an intuitive and convenient interaction method, gestures have received more and more attention. This paper proposes a gesture recognition method based on a three-dimensional hand skeleton model. By simulating the three-dimensional spatial distribution of hand joints, a simplified hand skeleton structure is constructed. By connecting the palm and each finger joint, a dynamic and static gesture model of the hand is formed, which further improves the accuracy and efficiency of gesture recognition. Experimental results show that this method can effectively recognize various gestures and maintain high recognition accuracy and real-time response capabilities in different environments. In addition, combined with multimodal technologies such as eye tracking, the intelligence level of the gesture recognition system can be further improved, bringing a richer and more intuitive user experience. In the future, with the continuous development of computer vision, deep learning and multimodal interaction technology, natural interaction based on gestures will play an important role in a wider range of application scenarios and promote revolutionary progress in human-computer interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。