用预期自由能指导采样,提升微手势识别在低数据噪声下的性能
Active Inference for Micro-Gesture Recognition: EFE-Guided Temporal Sampling and Adaptive Learning
- 基于预期自由能动态选择关键时间片段进行观测
- 通过预测不确定性加权样本,缓解标签噪声与分布偏移影响
- 适合可穿戴设备、人机交互及情绪临床监测场景
微手势是由无意识神经和情绪活动引发的细微短暂动作,在人机交互与临床监测中具有巨大潜力。然而其幅度小、持续时间短且个体差异大,导致现有深度模型在低样本、高噪声和跨被试条件下易退化。本文提出一种基于主动推理的微手势识别框架,包含预期自由能(EFE)引导的时间采样与不确定性感知的自适应学习机制。模型在EFE指导下主动选择最具判别性的时序片段,实现动态观测与信息增益最大化;同时,基于预测不确定性的样本加权策略有效缓解了标签噪声与分布偏移的影响。在SMG数据集上的实验表明,该方法在多个主流骨干网络上均取得一致改进。消融实验证实EFE引导观测与自适应学习机制对性能提升至关重要。本工作为低资源、高噪声条件下的时序行为建模提供了可解释且可扩展的新范式,适用于可穿戴传感、人机交互与临床情绪监测。
原文摘要 · Abstract (English)
Micro-gestures are subtle and transient movements triggered by unconscious neural and emotional activities, holding great potential for human-computer interaction and clinical monitoring. However, their low amplitude, short duration, and strong inter-subject variability make existing deep models prone to degradation under low-sample, noisy, and cross-subject conditions. This paper presents an active inference-based framework for micro-gesture recognition, featuring Expected Free Energy (EFE)-guided temporal sampling and uncertainty-aware adaptive learning. The model actively selects the most discriminative temporal segments under EFE guidance, enabling dynamic observation and information gain maximization. Meanwhile, sample weighting driven by predictive uncertainty mitigates the effects of label noise and distribution shift. Experiments on the SMG dataset demonstrate the effectiveness of the proposed method, achieving consistent improvements across multiple mainstream backbones. Ablation studies confirm that both the EFE-guided observation and the adaptive learning mechanism are crucial to the performance gains. This work offers an interpretable and scalable paradigm for temporal behavior modeling under low-resource and noisy conditions, with broad applicability to wearable sensing, HCI, and clinical emotion monitoring.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。