用视频识别动作并预测未来姿势,实现无人监督的康复指导
Autonomous Telerehabilitation via Skeletal Motion Prediction and Joint-Level Performance Assessment

- 通过自注意力双向LSTM分析骨骼动作质量,结合度量学习分类
- 在PROZIS数据集上动作识别准确率达96.45%,560毫秒预测误差75.8毫米
- 可定位关节偏差,适合居家康复与助老机器人部署
自主康复系统需不仅能识别人体运动,还需提供结构化反馈以支持用户在无持续治疗师监督下进行训练。本文提出一个基于无标记RGB视频的远程康复流水线,包含两个模块:基于骨架的动作质量评估与短期运动预测。采用自注意力双向LSTM结合MMD-NCA度量学习进行动作质量分类;图结构运动预测模块计算预测与实际姿态间各关节的位置误差,生成空间局部偏差信号。两个模块分别在基准数据集上独立评估:分类器在PROZIS数据集的深蹲序列上达到96.45%的平均类别准确率;所用STARS预测器在Human3.6M数据集上于560毫秒处实现75.8毫米的平均每关节位置误差(MPJPE),在所有预测时长上均优于图模型与递归基线。该框架旨在应用于辅助机器人与家庭康复场景;端到端集成与临床验证是未来重点方向。通过整合运动识别与预测,本工作推动了反馈驱动的自主远程康复发展,为更可及、可扩展的康复方案提供支持。
原文摘要 · Abstract (English)
Autonomous rehabilitation systems must not only recognize human motion but also provide structured feedback to support users without continuous therapist supervision. This paper presents a telerehabilitation pipeline that integrates skeleton-based exercise quality assessment and short-term motion prediction into a two-module system operating on marker-free RGB video. A self-attentive Bidirectional LSTM performs exercise quality classification using MMD-NCA metric learning, while a graph-based motion prediction module computes per-joint position errors between predicted and observed poses, generating spatially localized deviation signals. Each module is evaluated independently on established benchmarks: the classifier achieves 96.45% mean-class accuracy on squat sequences from the PROZIS dataset, and the adopted STARS predictor achieves a mean MPJPE of 75.8 mm at 560 ms on Human3.6M, outperforming graph and recurrent baselines across all prediction horizons. The framework is designed for eventual deployment in assistive robotics and home-based rehabilitation contexts; end-to-end integration and clinical validation are important directions for future work. By combining motion recognition and prediction in a single system, this work contributes a step toward autonomous, feedback-driven telerehabilitation, for more accessible and scalable rehabilitation solutions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。