arXiv:2503.22363cs.CVcs.AI2025-03

用视觉数据估算人机作用力,无需传感器也能实时分析。

ForcePose: A Deep Learning Approach for Force Calculation Based on Action Recognition Using MediaPipe Pose Estimation Combined with Object Detection

  • 结合姿态与物体检测,构建交互特征统一表示。
  • 力大小误差5.83牛,方向误差7.4度,比现有方法好27.5%。
  • 适合康复、运动、人因工程等真实场景应用。

人机交互中的力估计在人因工程、物理治疗和运动科学中至关重要。传统方法依赖力台或传感器等专用设备,成本高且局限于实验室环境。本文提出ForcePose,一种基于深度学习的力估算框架,结合MediaPipe姿态估计与SSD MobileNet物体检测,构建人机交互的统一表征。我们设计了专门的神经网络,融合空间与时间特征,实现无传感器的力大小与方向预测。在包含850段标注视频及对应力值测量的数据集上训练后,模型在力大小上的平均绝对误差为5.83 N,方向误差为7.4度。相比现有计算机视觉方法,性能提升27.5%,且可在标准硬件上实现实时运行。该方法为传统工具难以部署的真实场景下的力分析提供了新可能。论文还详述了方法、数据集构建、评估指标及在康复、人因工程和运动表现分析中的应用前景。

原文摘要 · Abstract (English)

Force estimation in human-object interactions is crucial for various fields like ergonomics, physical therapy, and sports science. Traditional methods depend on specialized equipment such as force plates and sensors, which makes accurate assessments both expensive and restricted to laboratory settings. In this paper, we introduce ForcePose, a novel deep learning framework that estimates applied forces by combining human pose estimation with object detection. Our approach leverages MediaPipe for skeletal tracking and SSD MobileNet for object recognition to create a unified representation of human-object interaction. We've developed a specialized neural network that processes both spatial and temporal features to predict force magnitude and direction without needing any physical sensors. After training on our dataset of 850 annotated videos with corresponding force measurements, our model achieves a mean absolute error of 5.83 N in force magnitude and 7.4 degrees in force direction. When compared to existing computer vision approaches, our method performs 27.5% better while still offering real-time performance on standard computing hardware. ForcePose opens up new possibilities for force analysis in diverse real-world scenarios where traditional measurement tools are impractical or intrusive. This paper discusses our methodology, the dataset creation process, evaluation metrics, and potential applications across rehabilitation, ergonomics assessment, and athletic performance analysis.

力估计姿态识别人机交互实时分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。