arXiv:2604.08106cs.CV2026-04

提出EPIR框架,高效识别微表情且计算量低。

EPIR: An Efficient Patch Tokenization, Integration and Representation Framework for Micro-expression Recognition

论文配图:EPIR: An Efficient Patch Tokenization, Integration and Representation Framework for Micro-expression Recognition
图 1 · 摘自论文原文
  • 用双范数位移分块法捕捉面部像素空间关系
  • 通过级联模块整合部分标记,减少计算量
  • 动态选择关键标记,提升微表情判别力

微表情识别可捕捉个体当下的真实情绪。尽管基于深度学习的Transformer方法已取得显著成果,但其因多头自注意力中大量标记导致计算复杂度高。此外,现有微表情数据集规模小,难以训练有效表示。为此,本文提出高效分块、融合与表征框架(EPIR),在保持高识别性能的同时降低计算开销。首先设计双范数位移分块(DNSPT)模块,通过精细化空间变换与双范数投影,学习面部区域相邻像素的空间关系;其次引入标记融合模块,在多级联Transformer块间整合部分标记,减少标记数量且不损失信息;最后设计判别性标记提取器,增强注意力机制以减少对自标记的冗余关注,并结合动态标记选择模块(DTSM)筛选关键标记,从而捕获更具判别性的微表情表征。在四个公开数据集(CASME II、SAMM、SMIC、CAS(ME)³)上进行广泛实验,结果表明该方法显著优于现有最优方法:在CAS(ME)³数据集上UF1提升9.6%,在SMIC数据集上UAR提升4.58%。

原文摘要 · Abstract (English)

Micro-expression recognition can obtain the real emotion of the individual at the current moment. Although deep learning-based methods, especially Transformer-based methods, have achieved impressive results, these methods have high computational complexity due to the large number of tokens in the multi-head self-attention. In addition, the existing micro-expression datasets are small-scale, which makes it difficult for Transformer-based models to learn effective micro-expression representations. Therefore, we propose a novel Efficient Patch tokenization, Integration and Representation framework (EPIR), which can balance high recognition performance and low computational complexity. Specifically, we first propose a dual norm shifted tokenization (DNSPT) module to learn the spatial relationship between neighboring pixels in the face region, which is implemented by a refined spatial transformation and dual norm projection. Then, we propose a token integration module to integrate partial tokens among multiple cascaded Transformer blocks, thereby reducing the number of tokens without information loss. Furthermore, we design a discriminative token extractor, which first improves the attention in the Transformer block to reduce the unnecessary focus of the attention calculation on self-tokens, and uses the dynamic token selection module (DTSM) to select key tokens, thereby capturing more discriminative micro-expression representations. We conduct extensive experiments on four popular public datasets (i.e., CASME II, SAMM, SMIC, and CAS(ME)3. The experimental results show that our method achieves significant performance gains over the state-of-the-art methods, such as 9.6% improvement on the CAS(ME)$^3$ dataset in terms of UF1 and 4.58% improvement on the SMIC dataset in terms of UAR metric.

微表情识别Transformer高效模型标记压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。