arXiv:2507.21977cs.CV2025-07中稿 · ACM MM 2025被引 35

通过运动引导模块提升骨骼动作识别中的细微变化捕捉能力

Motion Matters: Motion-guided Modulation Network for Skeleton-based Micro-Action Recognition

  • 引入运动引导的骨骼与时间调制模块,动态注入运动线索
  • 在Micro-Action 52和iMiGUE上达到当前最优性能
  • 适合关注细微动作识别与人体行为理解的研究者

微动作(MAs)是社交互动中重要的非语言交流形式,潜在应用于情感分析。现有方法常忽略微动作中隐含的细微变化,限制了对细微差异的区分能力。为此,我们提出一种新颖的运动引导调制网络(MMN),隐式捕捉并调制细微运动线索,以增强时空表征学习。具体地,设计运动引导骨骼调制模块(MSM),在骨骼层级注入运动线索作为控制信号,指导空间表征建模;同时构建运动引导时间调制模块(MTM),在帧层级融合运动信息,促进整体运动模式建模。最后,提出运动一致性学习策略,聚合多尺度特征中的运动线索用于微动作分类。在Micro-Action 52和iMiGUE数据集上的实验表明,MMN在骨架基微动作识别上达到当前最优表现,验证了显式建模细微运动线索的重要性。代码将开源于https://github.com/momiji-bit/MMN。

原文摘要 · Abstract (English)

Micro-Actions (MAs) are an important form of non-verbal communication in social interactions, with potential applications in human emotional analysis. However, existing methods in Micro-Action Recognition often overlook the inherent subtle changes in MAs, which limits the accuracy of distinguishing MAs with subtle changes. To address this issue, we present a novel Motion-guided Modulation Network (MMN) that implicitly captures and modulates subtle motion cues to enhance spatial-temporal representation learning. Specifically, we introduce a Motion-guided Skeletal Modulation module (MSM) to inject motion cues at the skeletal level, acting as a control signal to guide spatial representation modeling. In parallel, we design a Motion-guided Temporal Modulation module (MTM) to incorporate motion information at the frame level, facilitating the modeling of holistic motion patterns in micro-actions. Finally, we propose a motion consistency learning strategy to aggregate the motion cues from multi-scale features for micro-action classification. Experimental results on the Micro-Action 52 and iMiGUE datasets demonstrate that MMN achieves state-of-the-art performance in skeleton-based micro-action recognition, underscoring the importance of explicitly modeling subtle motion cues. The code will be available at https://github.com/momiji-bit/MMN.

动作识别微动作骨骼序列运动建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。