构建可自适应的帕金森数字孪生系统,实现人-机-智能协同干预。
Towards Human-AI-Robot Collaboration and AI-Agent based Digital Twins for Parkinson's Disease Management: Review and Outlook
- 提出闭环传感-AI-机器人框架,融合多模态生理数据与AI代理
- 通过数字孪生实现个性化、可解释的动态干预,支持长期管理
- 适合医疗健康、智能康复及人机协作领域的研究者与开发者
目前帕金森病(PD)的筛查、监测与管理研究主要沿两条独立路径发展:一是利用惯性测量单元(IMUs)、压力鞋垫、肌电图(EMG)、脑电图(EEG)、语音分析及RGB/RGB-D运动捕捉等非侵入式技术,进行多模态生物标志物采集、特征提取与机器学习分类;二是基于社交助手机器人(SARs)、机器人辅助康复(RAR)系统及虚拟现实集成平台,改善运动与认知功能,增强社会参与度,支持照护者。尽管目标互补,两领域在数据或决策层面耦合仍有限。随着大语言模型(LLMs)、代理型人工智能(agentic AI)等技术兴起,可构建闭环传感-AI-机器人系统:多模态感知持续驱动患者、照护者、人形机器人及医生间的交互,由多种AI模型(如机器人与可穿戴基础模型、基于LLM的推理、强化学习、持续学习)赋能的AI代理实现自适应决策。该系统支持个性化、可解释、情境感知的干预,形成随时间演化的帕金森病数字孪生,为智能、以患者为中心的长期护理奠定基础。
原文摘要 · Abstract (English)
The current body of research on Parkinson's disease (PD) screening, monitoring, and management has evolved along two largely independent trajectories. The first research community focuses on multimodal sensing of PD-related biomarkers using noninvasive technologies such as inertial measurement units (IMUs), force/pressure insoles, electromyography (EMG), electroencephalography (EEG), speech and acoustic analysis, and RGB/RGB-D motion capture systems. These studies emphasize data acquisition, feature extraction, and machine learning-based classification for PD screening, diagnosis, and disease progression modeling. In parallel, a second research community has concentrated on robotic intervention and rehabilitation, employing socially assistive robots (SARs), robot-assisted rehabilitation (RAR) systems, and virtual reality (VR)-integrated robotic platforms for improving motor and cognitive function, enhancing social engagement, and supporting caregivers. Despite the complementary goals of these two domains, their methodological and technological integration remains limited, with minimal data-level or decision-level coupling between the two. With the advent of advanced artificial intelligence (AI), including large language models (LLMs), agentic AI systems, a unique opportunity now exists to unify these research streams. We envision a closed-loop sensor-AI-robot framework in which multimodal sensing continuously guides the interaction between the patient, caregiver, humanoid robot (and physician) through AI agents that are powered by a multitude of AI models such as robotic and wearables foundation models, LLM-based reasoning, reinforcement learning, and continual learning. Such closed-loop system enables personalized, explainable, and context-aware intervention, forming the basis for digital twin of the PD patient that can adapt over time to deliver intelligent, patient-centered PD care.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。