arXiv:2503.07969cs.CV2025-03中稿 · ECCV

用循序渐进训练法提升复合表情识别准确率

7ABAW-Compound Expression Recognition via Curriculum Learning

  • 先学单表情特征,再逐步引入复合表情数据
  • 用CutMix和Mixup生成合成复合表情图像
  • 适合做情感计算与多模态学习的研究者参考

深度学习推动了表情识别的发展,但受限于标注的复合表情数据集稀缺以及复合表情细微差异,复合情绪识别(CE)仍有较大探索空间。为推进该任务,第七届野生情感行为分析竞赛(7ABAW)基于C-EXPR-DB数据集设立了复合表情挑战赛,该数据集无标签。本文提出一种基于课程学习的框架:先在单表情数据上预训练模型,掌握基础面部特征;随后利用CutMix和Mixup技术对原始单表情图像进行混合,生成具有多重基本情绪特征的合成图像;最后逐步引入多表情数据,使模型适应复合表情的复杂性与多样性。官方结果表明,本方法在该赛道取得最佳成绩,F-score达0.6063。代码已开源。

原文摘要 · Abstract (English)

With the advent of deep learning, expression recognition has made significant advancements. However, due to the limited availability of annotated compound expression datasets and the subtle variations of compound expressions, Compound Emotion Recognition (CE) still holds considerable potential for exploration. To advance this task, the 7th Affective Behavior Analysis in-the-wild (ABAW) competition introduces the Compound Expression Challenge based on C-EXPR-DB, a limited dataset without labels. In this paper, we present a curriculum learning-based framework that initially trains the model on single-expression tasks and subsequently incorporates multi-expression data. This design ensures that our model first masters the fundamental features of basic expressions before being exposed to the complexities of compound emotions. Specifically, our designs can be summarized as follows: 1) Single-Expression Pre-training: The model is first trained on datasets containing single expressions to learn the foundational facial features associated with basic emotions. 2) Dynamic Compound Expression Generation: Given the scarcity of annotated compound expression datasets, we employ CutMix and Mixup techniques on the original single-expression images to create hybrid images exhibiting characteristics of multiple basic emotions. 3) Incremental Multi-Expression Integration: After performing well on single-expression tasks, the model is progressively exposed to multi-expression data, allowing the model to adapt to the complexity and variability of compound expressions. The official results indicate that our method achieves the \textbf{best} performance in this competition track with an F-score of 0.6063. Our code is released at https://github.com/YenanLiu/ABAW7th.

表情识别课程学习情感计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。