arXiv:2603.22313cs.LGcs.AI2026-03被引 2

融合多模态数据与注意力机制,实现高精度实时老人跌倒检测

A Multi-Modal CNN-LSTM Framework with Multi-Head Attention and Focal Loss for Real-Time Elderly Fall Detection

  • 用多尺度CNN+注意力机制捕捉运动动态,融合加速度计、陀螺仪和生理信号
  • 在真实老人跌倒数据集上达到98.9%召回率,误报率显著降低
  • 适合部署在边缘设备,可为老年居家护理提供低延迟智能监控

全球老龄化加剧了对可靠健康监测系统的需求,尤其是针对老年人跌倒等紧急事件的检测。传统仅依赖加速度数据的方法误报率高,而常规机器学习需大量手工特征工程。本文提出MultiModalFallDetector框架,利用可穿戴传感器进行实时老人跌倒检测。该方法结合多尺度卷积神经网络提取不同时间粒度的运动特征,融合三轴加速度计、陀螺仪及四通道生理信号;引入多头自注意力机制实现动态时间加权;采用焦点损失缓解严重类别不平衡;设计辅助活动分类任务增强模型泛化能力;并基于UCI HAR数据集对SisFall数据集进行迁移学习。在包含60-85岁老年人真实模拟跌倒试验的SisFall数据集上,模型取得98.7的F1分数、98.9的召回率和99.4的AUC-ROC,显著优于基线方法。模型在边缘设备上推理延迟低于50毫秒,满足实时部署需求。

原文摘要 · Abstract (English)

The increasing global aging population has intensified the demand for reliable health monitoring systems, particularly those capable of detecting critical events such as falls among elderly individuals. Traditional fall detection approaches relying on single-modality acceleration data suffer from high false alarm rates, while conventional machine learning methods require extensive hand-crafted feature engineering. This paper proposes a novel multi-modal deep learning framework, MultiModalFallDetector, designed for real-time elderly fall detection using wearable sensors. Our approach integrates multiple innovations: a multi-scale CNN-based feature extractor capturing motion dynamics at varying temporal resolutions; fusion of tri-axial accelerometer, gyroscope, and four-channel physiological signals; incorporation of a multi-head self-attention mechanism for dynamic temporal weighting; adoption of Focal Loss to mitigate severe class imbalance; introduction of an auxiliary activity classification task for regularization; and implementation of transfer learning from UCI HAR to SisFall dataset. Extensive experiments on the SisFall dataset, which includes real-world simulated fall trials from elderly participants (aged 60-85), demonstrate that our framework achieves an F1-score of 98. 7, Recall of 98. 9, and AUC-ROC of 99. 4, significantly outperforming baseline methods including traditional machine learning and standard deep learning approaches. The model maintains sub- 50ms inference latency on edge devices, confirming its suitability for real-time deployment in geriatric care settings.

跌倒检测多模态学习边缘计算老年健康

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。