arXiv:2411.08882cs.MMcs.AI2024-11被引 14

用可穿戴设备和视频分析提前6分钟预测失智患者躁动,减少护理负担。

A Novel Multimodal System to Predict Agitation in People with Dementia Within Clinical Settings: A Proof of Concept

  • 融合智能手环与隐私保护视频,实时采集生理与行为信号。
  • 首次发现躁动前至少6分钟的预警模式,准确率显著提升。
  • 系统自动运行,适合临床长期监测,减轻人工记录压力。

痴呆是一种影响全球数百万人及其照护者的神经退行性疾病。尽管认知障碍严重,但精神行为症状(NPS)更直接影响生活质量。失智患者中的躁动与攻击行为(AA)导致痛苦并增加医疗需求。当前评估依赖照护者报告,存在主观偏差。人工智能与预测算法可在实时场景中提供解决方案。本文提出一项为期5年的多模态系统,结合EmbracePlus手环与视频检测系统,用于预测重度痴呆患者的AA事件。在安大略水源心理健康研究所对三名参与者开展试点研究。系统通过处理手环采集的原始及数字生物标志物,实现对AA的精准预测,并首次发现躁动前至少6分钟的预兆模式。隐私保护视频系统采用特征遮蔽技术隐藏人物身份,利用深度学习模型检测AA事件,同时辅助标注实际起止时间。初步数据分析结果表明该系统具备良好的预测能力。其能在无外部干预下实时自主运行,识别AA及前驱症状,是该领域的重要进展。

原文摘要 · Abstract (English)

Dementia is a neurodegenerative condition that combines several diseases and impacts millions around the world and those around them. Although cognitive impairment is profoundly disabling, it is the noncognitive features of dementia, referred to as Neuropsychiatric Symptoms (NPS), that are most closely associated with a diminished quality of life. Agitation and aggression (AA) in people living with dementia (PwD) contribute to distress and increased healthcare demands. Current assessment methods rely on caregiver intervention and reporting of incidents, introducing subjectivity and bias. Artificial Intelligence (AI) and predictive algorithms offer a potential solution for detecting AA episodes in PwD when utilized in real-time. We present a 5-year study system that integrates a multimodal approach, utilizing the EmbracePlus wristband and a video detection system to predict AA in severe dementia patients. We conducted a pilot study with three participants at the Ontario Shores Mental Health Institute to validate the functionality of the system. The system collects and processes raw and digital biomarkers from the EmbracePlus wristband to accurately predict AA. The system also detected pre-agitation patterns at least six minutes before the AA event, which was not previously discovered from the EmbracePlus wristband. Furthermore, the privacy-preserving video system uses a masking tool to hide the features of the people in frames and employs a deep learning model for AA detection. The video system also helps identify the actual start and end time of the agitation events for labeling. The promising results of the preliminary data analysis underscore the ability of the system to predict AA events. The ability of the proposed system to run autonomously in real-time and identify AA and pre-agitation symptoms without external assistance represents a significant milestone in this research field.

失智症多模态预警系统可穿戴设备

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。