提出新评估指标,系统比较24个表情识别数据集的优劣。
Evaluating Facial Expression Recognition Datasets for Deep Learning: A Benchmark Study with Novel Similarity Metrics
- 构建24个FER数据集的标准化处理流程,补充年龄性别标注。
- 引入局部、全局、配对相似性三项新指标,量化数据集难度与迁移能力。
- 发现大规模自动采集数据泛化更强,小规模控制数据标注更准。
本研究系统分析了24个广泛使用的面部表情识别(FER)数据集的关键特征及其对深度学习模型训练的适用性。在情感计算领域,FER对理解人类情绪至关重要,但其性能高度依赖于数据集的质量与多样性。为此,我们对包括儿童、成人和老年人在内的多类目标人群数据集进行了整理与分析,并通过全面的归一化处理流程进行预处理,同时为数据集添加自动标注的年龄与性别信息,以更精细地评估其人口统计学属性。为进一步评估数据集效能,本文提出三项新指标:局部相似性、全局相似性和配对相似性,分别用于量化数据集难度、泛化能力和跨数据集迁移性。基于先进神经网络的基准实验表明,大规模自动采集数据集(如AffectNet、FER2013)虽存在标注噪声和人口偏差问题,但具备更强的泛化能力;而受控数据集虽标注质量更高,但样本变异性有限。研究结果为数据集选择与设计提供了可操作建议,推动更鲁棒、公平、高效的FER系统发展。
原文摘要 · Abstract (English)
This study investigates the key characteristics and suitability of widely used Facial Expression Recognition (FER) datasets for training deep learning models. In the field of affective computing, FER is essential for interpreting human emotions, yet the performance of FER systems is highly contingent on the quality and diversity of the underlying datasets. To address this issue, we compiled and analyzed 24 FER datasets, including those targeting specific age groups such as children, adults, and the elderly, and processed them through a comprehensive normalization pipeline. In addition, we enriched the datasets with automatic annotations for age and gender, enabling a more nuanced evaluation of their demographic properties. To further assess dataset efficacy, we introduce three novel metricsLocal, Global, and Paired Similarity, which quantitatively measure dataset difficulty, generalization capability, and cross-dataset transferability. Benchmark experiments using state-of-the-art neural networks reveal that large-scale, automatically collected datasets (e.g., AffectNet, FER2013) tend to generalize better, despite issues with labeling noise and demographic biases, whereas controlled datasets offer higher annotation quality but limited variability. Our findings provide actionable recommendations for dataset selection and design, advancing the development of more robust, fair, and effective FER systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。