RePose实现实时3D人体姿态估计,助力康复训练精准反馈
RePose: A Real-Time 3D Human Pose Estimation and Biomechanical Analysis Framework for Rehabilitation
- 多摄像头RGB视频输入,端到端实时姿态与运动分析
- 单帧跟踪耗时<1ms,有效应对多人干扰场景
- 结合Unity可视化肌力分布,辅助患者纠正动作
我们提出一种名为RePose的实时3D人体姿态估计与生物力学分析框架,用于康复训练。该方法利用多摄像头的RGB视频输入,构建端到端的实时人体姿态估计与运动分析流水线,可实时监测并纠正患者的运动动作,帮助其恢复肌肉力量和运动功能。针对康复场景中的多人干扰问题,提出一种快速跟踪方法,单帧处理时间低于1ms。同时,改进SmoothNet模型以实现更准确的姿态估计,显著降低误差并使运动轨迹更平滑。最后,基于Unity平台实现患者运动状态的实时监控与评估,并可视化显示肌肉应力情况,为康复训练提供即时反馈与指导。
原文摘要 · Abstract (English)
We propose a real-time 3D human pose estimation and motion analysis method termed RePose for rehabilitation training. It is capable of real-time monitoring and evaluation of patients'motion during rehabilitation, providing immediate feedback and guidance to assist patients in executing rehabilitation exercises correctly. Firstly, we introduce a unified pipeline for end-to-end real-time human pose estimation and motion analysis using RGB video input from multiple cameras which can be applied to the field of rehabilitation training. The pipeline can help to monitor and correct patients'actions, thus aiding them in regaining muscle strength and motor functions. Secondly, we propose a fast tracking method for medical rehabilitation scenarios with multiple-person interference, which requires less than 1ms for tracking for a single frame. Additionally, we modify SmoothNet for real-time posture estimation, effectively reducing pose estimation errors and restoring the patient's true motion state, making it visually smoother. Finally, we use Unity platform for real-time monitoring and evaluation of patients' motion during rehabilitation, and to display the muscle stress conditions to assist patients with their rehabilitation training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。