arXiv:2507.08624cs.HCcs.AI2025-07

AI助康复:手机实时建模+虚拟形象,居家锻炼更安全有效

Adaptive Framework for Ambient Intelligence in Rehabilitation Assistance

  • 用手机实时3D重建环境,生成匹配身体的虚拟形象指导动作
  • 通过3D对比和大模型分析,提供动作纠错与详细反馈
  • 兼顾隐私保护与残障人士使用,可拓展至多种康复场景

本文提出面向家庭康复环境的环境智能康复辅助框架AIRS,融合实时3D重建(RT-3DR)、智能导航与大视觉语言模型(VLM),实现机器引导的物理康复。系统在全膝关节置换术后康复场景中验证,基于263段视频数据集评估。利用智能手机完成空间实时3D重建,并生成与用户体形匹配的虚拟形象,用于优化运动配置(如摄像头位置、患者姿势)并保障隐私合规。系统引导用户正确录制训练视频,采用双重反馈机制:一是3D可视化对比临床示范与居家录像,二是由大模型生成具体错误解释与修正建议。框架支持视障与听障用户,具备模块化设计,可扩展至更广泛的康复应用。所有软件组件开放供后续使用与定制。

原文摘要 · Abstract (English)

This paper introduces the Ambient Intelligence Rehabilitation Support (AIRS) framework, an advanced artificial intelligence-based solution tailored for home rehabilitation environments. AIRS integrates cutting-edge technologies, including Real-Time 3D Reconstruction (RT-3DR), intelligent navigation, and large Vision-Language Models (VLMs), to create a comprehensive system for machine-guided physical rehabilitation. The general AIRS framework is demonstrated in rehabilitation scenarios following total knee replacement (TKR), utilizing a database of 263 video recordings for evaluation. A smartphone is employed within AIRS to perform RT-3DR of living spaces and has a body-matched avatar to provide visual feedback about the excercise. This avatar is necessary in (a) optimizing exercise configurations, including camera placement, patient positioning, and initial poses, and (b) addressing privacy concerns and promoting compliance with the AI Act. The system guides users through the recording process to ensure the collection of properly recorded videos. AIRS employs two feedback mechanisms: (i) visual 3D feedback, enabling direct comparisons between prerecorded clinical exercises and patient home recordings and (ii) VLM-generated feedback, providing detailed explanations and corrections for exercise errors. The framework also supports people with visual and hearing impairments. It also features a modular design that can be adapted to broader rehabilitation contexts. AIRS software components are available for further use and customization.

康复AI3D重建多模态反馈居家护理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。