arXiv:2606.15763cs.CV2026-06被引 1

罕见情绪识别失败源于情感几何退化,而非数据不平衡。

The Circumplex Degeneracy Behind the Rare-Class Limit in Affect Recognition

论文配图:The Circumplex Degeneracy Behind the Rare-Class Limit in Affect Recognition
图 1 · 摘自论文原文
  • 用环形模型距离定义表情混淆代价,改进分类表现。
  • 退化对偶在两个数据集上均稳定存在,无法通过损失函数修复。
  • 需构建可区分稀有类别的表征,而非仅调整混淆代价。

真实场景中的表情识别在少数罕见情绪上持续失败,传统解释为类别不平衡。通过在两个基准上的受控多任务实验,我们发现失败实为情感几何特性所致:罕见类别在Russell环形模型中存在退化现象,这种退化限制了任何损失或代价函数所能达到的性能上限。我们引入一种基于环形-成本最优传输的项,按效价-唤醒度距离对表情混淆定价。该方法提升了官方得分与表达宏平均F1,但对照实验显示,等效于通用置信度惩罚的均匀代价在Aff-Wild2上表现相当(p=0.625),并在AffectNet上显著更优(比基线+0.057,超过环形项)。几何结构重塑了错误分布,在Aff-Wild2上使错误更贴近真实情感(p=0.031),但在AffectNet中因视觉混杂因素(环形远角)被掩盖。罕见类别失败在两数据集上均稳定存在:退化对偶(如Aff-Wild2的愤怒-恐惧,AffectNet的愤怒-轻蔑)不受频率干预、传输项及专为分离它们设计的动作单元增强代价影响。结论是,突破罕见表情识别需构建能区分类别的表征,而非仅重构混淆代价。本文提供控制实验与评估指标,以区分两类策略。

原文摘要 · Abstract (English)

In-the-wild expression recognition persistently fails on a few rare emotions, and the standard explanation is class imbalance. Through a controlled multi-task study on two benchmarks, we show the failure is instead a property of affect geometry: the rare classes are degenerate on Russell's circumplex, and that degeneracy bounds what any loss or cost can achieve. Our instrument is a circumplex-cost optimal-transport term that prices expression confusions by their valence-arousal distance. The term improves the official score and expression macro-F1, but a control most studies omit shows the gain is not geometric: a uniform cost, equivalent to a generic confidence penalty, matches it on Aff-Wild2 (p=0.625) and significantly exceeds it on AffectNet (+0.057 over base, larger than the circumplex). What the geometry reshapes is the structure of the errors, making them affectively nearer the truth on Aff-Wild2 (p=0.031 against the uniform control), an effect that does not survive on AffectNet, where a visual confound at the far corner of the circumplex overwhelms it. The rare-class failure, by contrast, is stable across both datasets we examine: the degenerate pairs (anger-fear on Aff-Wild2, anger-contempt on AffectNet) resist frequency-based interventions, the transport term, and an action-unit-augmented cost built specifically to separate them. We conclude that progress on rare expressions requires representations that distinguish the classes, not supervision that reprices their confusions, and we provide the controls and metrics needed to tell the two apart.

情感识别几何退化罕见类别环形模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。