用自适应边界差训练提升表情识别模型的鲁棒性。
Emotion Diffusion Classifier with Adaptive Margin Discrepancy Training for Facial Expression Recognition
- 引入生成式扩散模型结合动态调整的分类边界损失
- 在100步评估中准确率显著优于基线模型
- 适合需要高鲁棒性的实际情绪识别场景
面部表情识别(FER)对人机交互至关重要,使机器能从面部表情中理解人类情绪与内在状态。尽管深度学习大幅提升了FER性能,但现有方法多依赖判别式分类器,易学习捷径且对分布偏移敏感。为此,本文采用条件生成式扩散模型,提出情绪扩散分类器(EmoDC),增强了对抗鲁棒性。然而,标准重训练策略无法惩罚错误类别描述下的预测,导致性能不佳。为此,我们提出基于边距的差异训练,强制正确与错误类别在噪声预测误差间保持最小边距,提升判别能力。但固定边距难以适应不同图像的预测难度。因此,提出自适应边距差异训练(AMDiT),动态调整每样本边距。大量实验表明,AMDiT显著提升EmoDC在100步评估下的准确率,且泛化与鲁棒性优于当前最优判别式分类器。
原文摘要 · Abstract (English)
Facial Expression Recognition (FER) is essential for human-machine interaction, as it enables machines to interpret human emotions and internal states from facial affective behaviors. Although deep learning has significantly advanced FER performance, most existing deep-learning-based FER methods rely heavily on discriminative classifiers for fast predictions. These models tend to learn shortcuts and are vulnerable to even minor distribution shifts. To address this issue, we adopt a conditional generative diffusion model and introduce the Emotion Diffusion Classifier (EmoDC) for FER, which demonstrates enhanced adversarial robustness. However, retraining EmoDC using standard strategies fails to penalize incorrect categorical descriptions, leading to suboptimal recognition performance. To improve EmoDC, we propose margin-based discrepancy training, which encourages accurate predictions when conditioned on correct categorical descriptions and penalizes predictions conditioned on mismatched ones. This method enforces a minimum margin between noise-prediction errors for correct and incorrect categories, thereby enhancing the model's discriminative capability. Nevertheless, using a fixed margin fails to account for the varying difficulty of noise prediction across different images, limiting its effectiveness. To overcome this limitation, we propose Adaptive Margin Discrepancy Training (AMDiT), which dynamically adjusts the margin for each sample. Extensive experiments show that AMDiT significantly improves the accuracy of EmoDC over the baseline model with standard denoising diffusion training under 100-step evaluations. Additionally, AMDiT-enhanced EmoDC has better generalization and robustness than state-of-the-art discriminative classifiers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。