arXiv:2606.30309cs.CV2026-06中稿 · publication in IEE…

用点云变换器自动评估康复训练动作,无需专家现场指导。

A Point Cloud Transformer for Remote Monitoring and Automated Assessment of Physical Rehabilitation Exercises

论文配图:A Point Cloud Transformer for Remote Monitoring and Automated Assessment of Physical Rehabilitation Exercises
图 1 · 摘自论文原文
  • 基于点云的Transformer架构分析关节位置数据
  • 在三个基准数据集上准确率优于现有方法
  • 轻量高效,适合居家使用,可泛化到相似动作

康复训练对帕金森、腰痛等疾病患者恢复身体功能至关重要。传统训练依赖专家指导,成本高且难以普及。随着RGBD图像和关节位置数据的可用性提升,自动评估训练质量成为可能,更具成本效益且支持居家执行。然而,现有方法普遍存在特征提取不足、预处理复杂或忽略关键关节的问题。本文提出一种基于点云的Transformer框架,利用曲线式点云特征聚合技术增强信息表达,并引入轴向自注意力机制识别重要关节及其作用,提升动作评估效果。该系统在三个核心基准数据集(Kimore、UI-PRMD、IRDS)上表现优异,兼具小体积、快速推理和对相似动作的良好泛化能力,具有实际应用价值。

原文摘要 · Abstract (English)

Rehabilitation exercises are essential in restoring lost physical functions of patients suffering from various diseases (e.g., Parkinson's, back pain). Carrying out these rehabilitation exercises, often prescribed by health experts, is costly, unavailable, and requires expert supervision. The availability of RGBD images and movement/position data of joints along with expert annotation of exercise data has prompted the use of automatic assessment of the quality of rehabilitation exercises, which is cost-effective and can be carried out at home. However, existing approaches do not extract relevant features, lack practical application, require expensive pre-processing, or overlook crucial features. This study proposes a transformer-based framework for point clouds to extract features and assess rehabilitation exercises by analyzing joint positions collected through RGBD data. We adapt and utilize a curve-based point-cloud feature aggregation technique to augment point-cloud information that aids model output. The transformer architecture also uses axial self-attention, recognizing important joints and their roles to assist users in performing the exercise better. The guided system outperforms existing approaches and is also practically relevant due to its small size, fast inference, and generalization on specific joints in similar exercises. We conduct our experiments on three crucial baseline datasets for rehabilitation exercises: Kimore, UI-PRMD, and IRDS.

点云康复评估Transformer动作识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。