用动态阈值和负样本学习提升小标签数据下的表情识别效果
Semi-Supervised Facial Expression Recognition based on Dynamic Threshold and Negative Learning
- 通过动态阈值与选择性负学习,有效利用未标注数据
- 在RAF-DB和AffectNet上达到当前最优性能,甚至超越全监督方法
- 适合标注数据稀缺的表情识别场景,尤其适用于资源受限任务
表情识别是人机交互与情感计算的关键任务,但大量标注数据获取成本高。为此,本文提出基于动态阈值调整(DTA)与选择性负学习(SNL)的半监督表情识别算法。首先,在特征提取阶段引入局部注意力增强与特征图随机丢弃策略,强化局部特征表达并防止模型过拟合特定区域。其次,设计动态阈值机制以适应半监督学习需求,并通过选择性负学习策略,从低置信度未标注样本中挖掘互补标签中的有用表达信息。实验表明,该方法在RAF-DB和AffectNet数据集上均达到当前最优表现,即使未使用全部数据,仍优于部分全监督方法,验证了其有效性。
原文摘要 · Abstract (English)
Facial expression recognition is a key task in human-computer interaction and affective computing. However, acquiring a large amount of labeled facial expression data is often costly. Therefore, it is particularly important to design a semi-supervised facial expression recognition algorithm that makes full use of both labeled and unlabeled data. In this paper, we propose a semi-supervised facial expression recognition algorithm based on Dynamic Threshold Adjustment (DTA) and Selective Negative Learning (SNL). Initially, we designed strategies for local attention enhancement and random dropout of feature maps during feature extraction, which strengthen the representation of local features while ensuring the model does not overfit to any specific local area. Furthermore, this study introduces a dynamic thresholding method to adapt to the requirements of the semi-supervised learning framework for facial expression recognition tasks, and through a selective negative learning strategy, it fully utilizes unlabeled samples with low confidence by mining useful expression information from complementary labels, achieving impressive results. We have achieved state-of-the-art performance on the RAF-DB and AffectNet datasets. Our method surpasses fully supervised methods even without using the entire dataset, which proves the effectiveness of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。