针对跨文化表情识别偏差,提出新数据集与自适应校准模型。
Beyond Universality: The GCC-FER Dataset and Culture-Aware Adaptation for Dynamic Facial Expression Recognition

- 构建跨文化表情数据集GCC-FER,覆盖四大族裔23,934个视频样本
- 基于数据推导文化先验,实现对不同群体的动态表情精准识别
- 提出CA-FER系统,在多文化场景中稳定提升识别性能
动态面部表情识别(DFER)是情感计算、人机交互和智能多媒体系统的关键技术。尽管文化差异显著影响表情识别效果,现有多数系统仍假设情绪表达在人群中具有普适性。这种差异源于不同文化间面部肌肉激活模式的系统性区别。当前跨文化DFER发展的主要瓶颈在于缺乏多样化的基准数据集。为此,本文提出全球跨文化面部表情识别(GCC-FER)混合视频数据集,包含23,934个视频样本,覆盖非洲、白人、东亚和南亚四个文化群体,涵盖七种基本表情。数据通过心理学监督的内部采集与现有资源的严格族裔过滤相结合。据我们所知,这是首个为弥补人口代表性缺口而设计的大规模全球跨文化DFER数据集。基于该数据集,为每个文化群体推导出行为基础的文化先验,并建立适用于实际部署的全局先验。进一步提出文化感知的面部表情识别(CA-FER)系统,通过自适应重校准潜在面部表征以缓解文化偏差。在GCC-FER与DFEW上的大量实验表明,所提系统在多文化环境下均持续提升识别性能。
原文摘要 · Abstract (English)
Dynamic Facial Expression Recognition (DFER) is a key enabling technology in affective computing, human-computer interaction, and intelligent multimedia systems. Despite the significant influence of cultural nuances on FER performance, most existing FER systems assume that emotional expressions are universally consistent across populations. This variation can be attributed to systematic differences in facial muscle activation patterns across cultures. A major challenge in advancing cross-cultural FER lies in the scarcity of culturally diverse benchmark datasets. To address this, a new hybrid multicultural video dataset termed Global Cross-Cultural Facial Expression Recognition (GCC-FER) is introduced. GCC-FER comprises 23,934 video samples spanning four cultural groups (African, Caucasian, East Asian, and South Asian) across seven basic expressions, combining psychologically supervised in-house data collection for underrepresented populations with rigorous ethnicity filtering of existing sources. To the best of our knowledge, GCC-FER is the first large-scale global cross-cultural DFER dataset designed to address these demographic gaps. Leveraging this dataset, behaviorally grounded cultural priors are derived for each cultural group and a global prior for practical deployment. A Culture-Aware FER (CA-FER) system is proposed to mitigate cultural bias by adaptively recalibrating latent facial representations. Extensive experiments on GCC-FER and DFEW demonstrate that the proposed system consistently improves FER performance across multicultural settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。