arXiv:2411.19000cs.HCcs.AI2024-11被引 3

用多模态技术实现中风后患者居家康复的智能监测与实时辅助。

An AI-Driven Multimodal Smart Home Platform for Continuous Monitoring and Assistance in Post-Stroke Motor Impairment

  • 融合可穿戴、环境传感器与自适应自动化,实现持续康复监测。
  • 步态阶段识别准确率达94%,设备控制成功率100%且响应低于1秒。
  • 嵌入式大模型提供个性化提醒与环境调节,提升用户满意度至8.4分。

中风后患者居家康复面临挑战,因临床外难以获得持续个性化照护。现有整合方案无法同步监测运动恢复并提供智能协助,影响康复效果。本文提出一种多模态智能家居平台,用于中风患者居家连续康复,集成可穿戴传感、环境监测与自适应自动化。搭载机器学习管道的足底压力鞋垫可将用户分类至运动恢复阶段,准确率达94%,实现日常活动中的步行模式量化追踪。可选头戴式眼动模块结合摄像头、麦克风等环境传感器,支持无缝免手操作家用设备,成功率达100%,响应时间低于1秒。多源数据通过分层物联网架构本地融合,保障低延迟与数据隐私。嵌入式大型语言模型代理Auto-Care持续解析多模态数据,实时提供个性化干预——包括提醒、环境调节及通知照护者。在20名患者中,系统使用户满意度从3.9±0.8提升至8.4±0.6。该平台不仅适用于中风康复,更可拓展至更广泛的神经康复与居家养老场景。

原文摘要 · Abstract (English)

At-home rehabilitation for post-stroke patients presents significant challenges, as continuous, personalized care is often limited outside clinical settings. Moreover, the lack of integrated solutions capable of simultaneously monitoring motor recovery and providing intelligent assistance in home environments hampers rehabilitation outcomes. Here, we present a multimodal smart home platform designed for continuous, at-home rehabilitation of post-stroke patients, integrating wearable sensing, ambient monitoring, and adaptive automation. A plantar pressure insole equipped with a machine learning pipeline classifies users into motor recovery stages with up to 94\% accuracy, enabling quantitative tracking of walking patterns during daily activities. An optional head-mounted eye-tracking module, together with ambient sensors such as cameras and microphones, supports seamless hands-free control of household devices with a 100\% success rate and sub-second response time. These data streams are fused locally via a hierarchical Internet of Things (IoT) architecture, ensuring low latency and data privacy. An embedded large language model (LLM) agent, Auto-Care, continuously interprets multimodal data to provide real-time interventions -- issuing personalized reminders, adjusting environmental conditions, and notifying caregivers. Implemented in a post-stroke context, this integrated smart home platform increased mean user satisfaction from 3.9 $\pm$ 0.8 in conventional home environments to 8.4 $\pm$ 0.6 with the full system ($n=20$). Beyond stroke, the system offers a scalable, patient-centered framework with potential for long-term use in broader neurorehabilitation and aging-in-place applications.

智能康复多模态感知居家护理大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。