用骨架数据识别康复动作错误,让患者知道哪里做错了。
Skeleton-Based Transformer for Classification of Errors and Better Feedback in Low Back Pain Physical Rehabilitation Exercises
- 基于骨骼关键点设计Transformer模型,识别动作错误类型。
- 在KERAAL数据集上准确率显著超越现有方法。
- 可分析各关节对错误的贡献度,为个性化反馈提供依据。
由医疗专业人员建议的物理康复训练有助于缓解多种肌肉骨骼疾病并预防复发。然而,缺乏直接监督会导致患者参与度随时间下降,因此亟需自动化监测系统。近年来,康复动作质量评估取得显著进展,但多数方法仅输出正确或错误的二分类结果,少数提供连续评分,这些信息不足以帮助患者改进。本文提出一种用于康复动作错误分类的算法,迈出实现更详细反馈的第一步。聚焦于基于骨架的动作评估,利用人体姿态估计来判断运动表现。受近期康复动作质量评估方法启发,我们提出一种基于Transformer的模型,灵感源自用于人体动作识别的HyperFormer方法,并针对本问题和数据集进行了适配。评估在包含明确错误标签的唯一医学数据集KERAAL上进行,结果表明我们的模型显著优于现有最先进方法。此外,我们进一步提出一种计算各关节在每项动作中重要性的方法,以推动向患者提供更优反馈。
原文摘要 · Abstract (English)
Physical rehabilitation exercises suggested by healthcare professionals can help recovery from various musculoskeletal disorders and prevent re-injury. However, patients' engagement tends to decrease over time without direct supervision, which is why there is a need for an automated monitoring system. In recent years, there has been great progress in quality assessment of physical rehabilitation exercises. Most of them only provide a binary classification if the performance is correct or incorrect, and a few provide a continuous score. This information is not sufficient for patients to improve their performance. In this work, we propose an algorithm for error classification of rehabilitation exercises, thus making the first step toward more detailed feedback to patients. We focus on skeleton-based exercise assessment, which utilizes human pose estimation to evaluate motion. Inspired by recent algorithms for quality assessment during rehabilitation exercises, we propose a Transformer-based model for the described classification. Our model is inspired by the HyperFormer method for human action recognition, and adapted to our problem and dataset. The evaluation is done on the KERAAL dataset, as it is the only medical dataset with clear error labels for the exercises, and our model significantly surpasses state-of-the-art methods. Furthermore, we bridge the gap towards better feedback to the patients by presenting a way to calculate the importance of joints for each exercise.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。