用物理模型检测跌倒,能在低功耗设备上实时运行。
Real-time fall detection based on vision for low-power edge platforms

- 将跌倒视为人体支撑系统失稳,用双子系统建模重心与支撑面动态。
- 仅需不到5万个参数,在边缘设备实现亚50毫秒实时推理。
- 通过物理可解释性提升可信度,适合养老与智能监控场景。
跌倒检测对老年人照护和智能监控至关重要;然而,现有视觉方法多将其视为静态姿态分类或离散时序模式匹配,忽略了人体支撑系统的不稳定性动态。本文提出一种基于物理信息的跌倒检测框架,将跌倒重新定义为耦合动力系统中的失稳事件。设计了一种新型双液态时间常数(dual-LTC)架构,包含质心(CoM)与支撑基底(BoS)两个子系统,均采用液态时间常数神经网络,通过自适应时间常数持续建模惯性轨迹演化与地面接触调整。引入可学习耦合模块模拟两子系统间的物理交互,结合李雅普诺夫启发式稳定性指标,在联合隐空间中检测稳定性边界穿越。辅以反事实轨迹投影与碰撞时间(TTC)估计,实现不可逆性评估与早期预警。该架构支持三状态预测(正常、跌倒、已倒),本研究先在二分类数据集(正常 vs. 跌倒)上验证核心稳定性判别能力,完整三状态时序转换留待后续工作。相比传统CNN-RNN流水线,该方法编码连续时间机械惯性,构建出参数少于50K的轻量级网络,可在资源受限边缘设备上实现实时推理。大量实验表明其精度具有竞争力,且具备更优的物理可解释性,验证了其在低计算量视觉跌倒检测中的有效性。
原文摘要 · Abstract (English)
Falling detection is vital for elderly care and intelligent surveillance; however, prevailing vision-based approaches predominantly frame it as static pose classification or discrete temporal pattern matching, fundamentally overlooking the instability dynamics of the human support system. This paper proposes a physics-informed falling detection framework that recasts falling as a stability-loss event in a coupled dynamical system. We introduce a novel dual-LTC architecture comprising a Center-of-Mass (CoM) subsystem and a Base-of-Support (BoS) subsystem, both instantiated as Liquid Time-Constant (LTC) neural networks to continuously model inertial trajectory evolution and ground-contact adjustment through adaptive time constants, Physical interpretability of falling motion. A learnable coupling module emulates physical interaction between the two subsystems, while a Stability Manifold classifier operates in the joint latent space to detect boundary crossing via Lyapunov-inspired stability metrics. Complementary counterfactual trajectory projection and Time-to-Collision (TTC) estimation further enable irreversibility assessment and early warning. The architecture is designed to support a three-state prediction paradigm (Normal, Falling, Fallen); in this preliminary study, we validate the core stability discrimination capability on a two-class dataset (Normal vs. Falling), leaving the full three-state temporal transition to future work. Unlike conventional CNN--RNN pipelines, the proposed formulation encodes continuous-time mechanical inertia, yielding a sub-50K-parameter network capable of real-time inference on resource-constrained edge devices. Extensive experiments demonstrate competitive accuracy with superior physical interpretability, validating its efficacy for low-compute visual fall detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。