arXiv:2510.13557cs.CVcs.AI2025-10中稿 · presentation at th…被引 2

研究跨文化表情识别在模糊图像下的表现差异,发现文化构成影响模型鲁棒性。

Modeling Cultural Bias in Facial Expression Recognition with Adaptive Agents

  • 用自适应代理模拟不同文化群体在模糊图像中的交互行为
  • 亚洲组在低模糊下表现更好但中等模糊时骤降,西方组更均匀退化
  • 混合群体中平衡组成可缓解早期退化,不均衡则放大主导群体弱点

面部表情识别(FER)需在跨文化差异和视觉质量下降条件下保持稳健,但现有评估多假设数据同质且图像清晰。本文提出基于代理的流式基准,揭示跨文化构成与渐进模糊如何共同影响识别鲁棒性。每个代理在冻结的CLIP特征空间中运行,使用轻量级残差适配器在线训练于sigma=0,并在测试时固定。代理在5x5网格中移动互动,环境提供sigma调度的高斯模糊输入。考察纯文化群体(仅西方、仅亚洲)及平衡(5/5)与不平衡(8/2, 2/8)混合环境,以及不同空间接触结构。结果表明文化群体间存在明显非对称退化曲线:JAFFE(亚洲)群体在低模糊时性能更高,但在中等模糊阶段急剧下降;而KDEF(西方)群体退化更均匀。混合群体呈现中间模式,平衡混合缓解早期退化,但不平衡设置在高模糊下加剧多数群体的弱点。研究量化了文化构成与交互结构对FER鲁棒性的影响。

原文摘要 · Abstract (English)

Facial expression recognition (FER) must remain robust under both cultural variation and perceptually degraded visual conditions, yet most existing evaluations assume homogeneous data and high-quality imagery. We introduce an agent-based, streaming benchmark that reveals how cross-cultural composition and progressive blurring interact to shape face recognition robustness. Each agent operates in a frozen CLIP feature space with a lightweight residual adapter trained online at sigma=0 and fixed during testing. Agents move and interact on a 5x5 lattice, while the environment provides inputs with sigma-scheduled Gaussian blur. We examine monocultural populations (Western-only, Asian-only) and mixed environments with balanced (5/5) and imbalanced (8/2, 2/8) compositions, as well as different spatial contact structures. Results show clear asymmetric degradation curves between cultural groups: JAFFE (Asian) populations maintain higher performance at low blur but exhibit sharper drops at intermediate stages, whereas KDEF (Western) populations degrade more uniformly. Mixed populations exhibit intermediate patterns, with balanced mixtures mitigating early degradation, but imbalanced settings amplify majority-group weaknesses under high blur. These findings quantify how cultural composition and interaction structure influence the robustness of FER as perceptual conditions deteriorate.

表情识别文化偏差鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。