arXiv:2505.18412cs.CVcs.HC2025-05被引 7

用大模型生成康复动作反馈,提升居家训练效果。

Rehabilitation Exercise Quality Assessment and Feedback Generation Using Large Language Models with Prompt Engineering

  • 从骨骼关节数据提取特征,输入大模型生成自然语言反馈。
  • 在两个公开数据集上表现良好,能准确评估动作质量并推理改进方案。
  • 适合开发智能康复平台,帮助患者自主训练、减少医疗负担。

基于运动的康复可改善生活质量,降低发病率、死亡率和再入院率,但交通限制与医护人员短缺导致高脱落率。虚拟平台使患者可在家中完成康复训练,人工智能算法可分析表现、提供反馈并更新医生。尽管已有大量研究使用机器学习和深度学习进行动作质量评估,但很少探索大语言模型(LLMs)在反馈生成中的应用,且受限于缺乏包含文本反馈的康复数据集。本文提出一种新方法:从患者执行康复动作时的骨骼关节点中提取特定特征,并输入预训练大模型。通过零样本、少样本、思维链和角色扮演等多种提示技术,大模型可评估动作质量并以自然语言生成反馈,帮助患者改进动作。该方法在两个公开的康复动作评估数据集(UI-PRMD 和 REHAB24-6)上进行了广泛实验,展现出在动作评估、推理和反馈生成方面的良好性能。该方法可集成至虚拟康复平台,帮助患者正确完成训练,支持康复进程,改善健康结果。

原文摘要 · Abstract (English)

Exercise-based rehabilitation improves quality of life and reduces morbidity, mortality, and rehospitalization, though transportation constraints and staff shortages lead to high dropout rates from rehabilitation programs. Virtual platforms enable patients to complete prescribed exercises at home, while AI algorithms analyze performance, deliver feedback, and update clinicians. Although many studies have developed machine learning and deep learning models for exercise quality assessment, few have explored the use of large language models (LLMs) for feedback and are limited by the lack of rehabilitation datasets containing textual feedback. In this paper, we propose a new method in which exercise-specific features are extracted from the skeletal joints of patients performing rehabilitation exercises and fed into pre-trained LLMs. Using a range of prompting techniques, such as zero-shot, few-shot, chain-of-thought, and role-play prompting, LLMs are leveraged to evaluate exercise quality and provide feedback in natural language to help patients improve their movements. The method was evaluated through extensive experiments on two publicly available rehabilitation exercise assessment datasets (UI-PRMD and REHAB24-6) and showed promising results in exercise assessment, reasoning, and feedback generation. This approach can be integrated into virtual rehabilitation platforms to help patients perform exercises correctly, support recovery, and improve health outcomes.

康复评估大模型动作分析智能反馈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。