arXiv:2604.17899cs.CV2026-04

提出新网络分离微表情中的动作与情绪特征,提升识别准确率。

MEDN: Motion-Emotion Feature Decoupling Network for Micro-Expression Recognition

论文配图:MEDN: Motion-Emotion Feature Decoupling Network for Micro-Expression Recognition
图 1 · 摘自论文原文
  • 双分支结构分别提取运动与情绪特征,减少混淆
  • 引入稀疏情感视觉变换器,捕捉局部时序变化
  • 适合需要高精度微表情分析的安防与医疗场景

与宏表情不同,微表情不存在情绪与动作单元(AUs)间的严格映射关系。部分微表情虽共享相同AUs,却代表相反情绪类别,视觉上极为相似。现有微表情识别(MER)方法主要依赖显式面部运动线索(如光流、帧差、AU特征),忽略隐含情绪信息。本文提出运动-情绪特征解耦网络(MEDN),设计双分支架构,分别提取运动与情绪特征。运动分支通过AU检测任务约束特征在显式运动域,并采用正交损失降低运动与情绪特征耦合。为建模隐含情绪,提出稀疏情感视觉变压器(SEVit),通过多尺度稀疏率压缩空间令牌,突出局部时序变化。进一步设计协同融合模块(CoFM),自适应融合解耦后的运动与情绪特征。在三个基准数据集上的大量实验表明,MEDN能有效解耦特征,显著提升识别性能,为增强识别精度与泛化能力提供新思路。

原文摘要 · Abstract (English)

Unlike macro-expression, micro-expression does not follow a strictly consistent mapping rule between emotions and Action Units (AUs). As a result, some micro-expressions share identical AUs yet represent completely opposite emotional categories, making them highly visually similar. Existing microexpression recognition (MER) methods mostly rely on explicit facial motion cues (e.g., optical flow, frame differences, AU features) while ignoring implicit emotion information. To tackle this issue, this paper presents a Motion Emotion Feature Decoupling Network (MEDN) for MER. We design a dual-branch framework to separately extract motion and emotion features. In the motion branch, an AU-detection task restricts features to the explicit motion domain, and orthogonal loss is adopted to reduce motion emotion feature coupling. For implicit emotion modeling, we propose a Sparse Emotion Vision Transformer (SEVit) that sparsifies spatial tokens to highlight local temporal variations with multi-scale sparsity rates. A Collaborative Fusion Module (CoFM) is further developed to fuse disentangled motion and emotion features adaptively. Extensive experiments on three benchmark datasets validate that MEDN effectively decouples motion and emotion features and achieves superior recognition performance, offering a new perspective for enhancing recognition accuracy and generalization.

微表情识别特征解耦视觉变换器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。