arXiv:2603.24097cs.CV2026-03

引入物理动力学提升骨骼动作分割的边界精度与类别区分度。

LaDy: Lagrangian-Dynamic Informed Network for Skeleton-based Action Segmentation via Spatial-Temporal Modulation

  • 基于拉格朗日力学计算广义坐标与力,显式建模人体运动动力学。
  • 在多个数据集上达到最新性能,边界定位准确率显著提升。
  • 适合关注动作语义与物理规律结合的研究者或应用开发者。

基于骨骼的动作时序分割(STAS)旨在将未剪辑的骨骼序列密集划分成帧级动作类别。现有方法虽能捕捉时空运动特征,却忽略了驱动人体运动的物理动力学机制,导致相似运动模式下不同动作难以区分,且动态力变化处边界定位不准。为此,本文提出拉格朗日动力学感知网络(LaDy),将拉格朗日力学原理融入分割流程:首先从关节点位置计算广义坐标,再在物理约束下估计拉格朗日项以显式合成广义力;通过能量一致性损失强制满足功-能定理,使动能变化与净力做功对齐。学习到的动力学信息驱动时空调制模块:空间上,广义力与空间表征融合,增强语义判别性;时间上,构建显著动态信号用于时序门控,显著提升边界感知能力。在多个挑战性数据集上的实验表明,LaDy实现当前最优性能,验证了物理动力学整合的有效性。代码已开源:https://github.com/HaoyuJi/LaDy。

原文摘要 · Abstract (English)

Skeleton-based Temporal Action Segmentation (STAS) aims to densely parse untrimmed skeletal sequences into frame-level action categories. However, existing methods, while proficient at capturing spatio-temporal kinematics, neglect the underlying physical dynamics that govern human motion. This oversight limits inter-class discriminability between actions with similar kinematics but distinct dynamic intents, and hinders precise boundary localization where dynamic force profiles shift. To address these, we propose the Lagrangian-Dynamic Informed Network (LaDy), a framework integrating principles of Lagrangian dynamics into the segmentation process. Specifically, LaDy first computes generalized coordinates from joint positions and then estimates Lagrangian terms under physical constraints to explicitly synthesize the generalized forces. To further ensure physical coherence, our Energy Consistency Loss enforces the work-energy theorem, aligning kinetic energy change with the work done by the net force. The learned dynamics then drive a Spatio-Temporal Modulation module: Spatially, generalized forces are fused with spatial representations to provide more discriminative semantics. Temporally, salient dynamic signals are constructed for temporal gating, thereby significantly enhancing boundary awareness. Experiments on challenging datasets show that LaDy achieves state-of-the-art performance, validating the integration of physical dynamics for action segmentation. Code is available at https://github.com/HaoyuJi/LaDy.

动作分割物理建模骨骼分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。