arXiv:2509.05337cs.CVcs.RO2025-09被引 1

用图神经网络+LSTM提前预测跌倒,能识别不稳状态。

Anticipatory Fall Detection in Humans with Hybrid Directed Graph Neural Networks and Long Short-Term Memory

  • 分两步:图网络判步态状态,LSTM预测下一步动作
  • 在OUMVLP-Pose和URFD数据集上准确率更高
  • 适合开发智能助老/康复系统,可监测危险前兆

跌倒检测与预防是辅助机器人系统的关键。尽管跌倒检测已有进展,但跌倒前的预测及稳定与跌倒之间的过渡状态分析仍待探索。本文提出一种融合动态图神经网络(DGNN)与长短期记忆(LSTM)的混合模型,将运动预测与步态分类解耦,实现高精度的跌倒预判。模型以视频序列提取的实时骨骼特征为输入,DGNN负责区分三种步态状态:稳定、过渡、跌倒;LSTM则预测后续时间步的人体运动,实现早期预警。模型在OUMVLP-Pose和URFD数据集上训练验证,相比仅使用DGNN或文献中模型,在预测误差和识别准确率上均表现更优。结果表明,解耦预测与分类优于单一模型统一处理。此外,该方法可有效监控过渡状态,为先进辅助系统提供关键洞察。

原文摘要 · Abstract (English)

Detecting and preventing falls in humans is a critical component of assistive robotic systems. While significant progress has been made in detecting falls, the prediction of falls before they happen, and analysis of the transient state between stability and an impending fall remain unexplored. In this paper, we propose a anticipatory fall detection method that utilizes a hybrid model combining Dynamic Graph Neural Networks (DGNN) with Long Short-Term Memory (LSTM) networks that decoupled the motion prediction and gait classification tasks to anticipate falls with high accuracy. Our approach employs real-time skeletal features extracted from video sequences as input for the proposed model. The DGNN acts as a classifier, distinguishing between three gait states: stable, transient, and fall. The LSTM-based network then predicts human movement in subsequent time steps, enabling early detection of falls. The proposed model was trained and validated using the OUMVLP-Pose and URFD datasets, demonstrating superior performance in terms of prediction error and recognition accuracy compared to models relying solely on DGNN and models from literature. The results indicate that decoupling prediction and classification improves performance compared to addressing the unified problem using only the DGNN. Furthermore, our method allows for the monitoring of the transient state, offering valuable insights that could enhance the functionality of advanced assistance systems.

跌倒预测图神经网络LSTM动作识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。