arXiv:2511.14620cs.CV2025-11被引 1

融合生物力学与时空特征,提升跌倒预测精度并缓解仿真到现实的差距

Fusing Biomechanical and Spatio-Temporal Features for Fall Prediction: Characterizing and Mitigating the Simulation-to-Reality Gap

  • 双流网络融合姿态与生物力学信息,通过交叉注意力机制实现特征互补
  • 在模拟数据上比基线模型提升5.32%和2.91%的F1分数,但真实场景零样本泛化仅35.9%
  • 针对老年人群提出个性化策略,强调隐私保护数据流程以推动真实世界验证

跌倒是老年人受伤和丧失独立性的主要原因。基于视觉的跌倒预测系统可在撞击前数秒预警,但受限于真实跌倒数据稀缺。本文提出生物力学时空图卷积网络(BioST-GCN),采用双流架构融合姿态与生物力学信息,并通过交叉注意力机制实现特征融合。在模拟的MCF-UA演员动作和MUVIM数据集上,该模型相比基线ST-GCN分别提升5.32%和2.91%的F1分数。时空注意力机制还能识别关键关节与时间阶段,增强可解释性。然而,仿真-现实差距显著:全监督下模拟数据表现达89.0% F1,但对未见受试者零样本迁移骤降至35.9%。这一性能下降可能源于仿真数据中的‘意图跌倒’线索。对于糖尿病或衰弱老年人,其独特的运动模式更放大此差距。为此,本文提出个性化策略,并倡导隐私保护的数据管道,以支持真实场景验证。研究强调必须弥合仿真与现实数据鸿沟,才能为脆弱老年群体开发有效跌倒预测系统。

原文摘要 · Abstract (English)

Falls are a leading cause of injury and loss of independence among older adults. Vision-based fall prediction systems offer a non-invasive solution to anticipate falls seconds before impact, but their development is hindered by the scarcity of available fall data. Contributing to these efforts, this study proposes the Biomechanical Spatio-Temporal Graph Convolutional Network (BioST-GCN), a dual-stream model that combines both pose and biomechanical information using a cross-attention fusion mechanism. Our model outperforms the vanilla ST-GCN baseline by 5.32% and 2.91% F1-score on the simulated MCF-UA stunt-actor and MUVIM datasets, respectively. The spatio-temporal attention mechanisms in the ST-GCN stream also provide interpretability by identifying critical joints and temporal phases. However, a critical simulation-reality gap persists. While our model achieves an 89.0% F1-score with full supervision on simulated data, zero-shot generalization to unseen subjects drops to 35.9%. This performance decline is likely due to biases in simulated data, such as 'intent-to-fall' cues. For older adults, particularly those with diabetes or frailty, this gap is exacerbated by their unique kinematic profiles. To address this, we propose personalization strategies and advocate for privacy-preserving data pipelines to enable real-world validation. Our findings underscore the urgent need to bridge the gap between simulated and real-world data to develop effective fall prediction systems for vulnerable elderly populations.

跌倒预测生物力学仿真-现实差距老年人健康

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。