基于AI的居家中风康复评估系统,实时分析动作质量并反馈。
AI-Based Stroke Rehabilitation Domiciliary Assessment System with ST_GCN Attention
- 用RGB-D相机与可穿戴设备捕捉运动数据,结合时空图网络与注意力机制评估动作。
- 在KIMORE和自建NRC数据集上,误差指标比基线降低12%-18%。
- 适合需要长期居家康复监测的患者及临床医生使用。
有效的中风康复需融入日常生活持续进行。为此,我们提出一个居家康复训练与反馈系统,包含三部分:(1)配备RGB-D相机和可穿戴传感器的硬件装置,用于捕捉中风患者的运动;(2)移动端应用提供训练指导;(3)AI服务器实现评估与反馈。用户按应用指引锻炼时,系统记录骨骼序列,并由深度学习模型RAST-G@(Rehabilitation Assessment Spatio-Temporal Graph ATtention)进行评估。该模型采用时空图卷积网络提取骨骼特征,并引入基于Transformer的时序注意力机制分析动作质量。为支持系统开发,我们构建了NRC数据集,包含10项上肢日常生活活动(ADL)和5项关节活动度(ROM)数据,来自中风及非残疾参与者,评分由持证理疗师标注。在KIMORE和NRC数据集上的结果表明,RAST-G@在平均绝对差(MAD)、均方根误差(RMSE)和平均绝对百分比误差(MAPE)方面优于基线模型。此外,系统能提供融合患者中心评估与监控的个性化反馈。结果证明,该系统为可扩展的定量、一致的居家康复评估提供了有效方案。
原文摘要 · Abstract (English)
Effective stroke recovery requires continuous rehabilitation integrated with daily living. To support this need, we propose a home-based rehabilitation exercise and feedback system. The system consists of (1) hardware setup with RGB-D camera and wearable sensors to capture stroke movements, (2) a mobile application for exercise guidance, and (3) an AI server for assessment and feedback. When a stroke user exercises following the application guidance, the system records skeleton sequences, which are then assessed by the deep learning model, RAST-G@ (Rehabilitation Assessment Spatio-Temporal Graph ATtention). The model employs a spatio-temporal graph convolutional network to extract skeletal features and integrates transformer-based temporal attention to figure out action quality. For system implementation, we constructed the NRC dataset, include 10 upper-limb activities of daily living (ADL) and 5 range-of-motion (ROM) collected from stroke and non-disabled participants, with Score annotations provided by licensed physiotherapists. Results on the KIMORE and NRC datasets show that RAST-G@ improves over baseline in terms of MAD, RMSE, and MAPE. Furthermore, the system provides user feedback that combines patient-centered assessment and monitoring. The results demonstrate that the proposed system offers a scalable approach for quantitative and consistent domiciliary rehabilitation assessment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。