arXiv:2601.13024cs.CL2026-01ACL被引 8

构建跨文化情感响应基准,评估大模型对情绪的本土化理解能力

Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responses

  • 用大模型生成初标签,再经人工校验,构建多语言情感数据集
  • 涵盖14种细粒度情绪,覆盖7种语言,共10962个图文与纯文本样本
  • 发现语言能力强的模型未必懂文化情绪,提示当前模型仍存理解鸿沟

文化深刻影响人类情感认知方式,但现有大模型评估多聚焦地理知识等事实性内容,难以捕捉跨文化情绪解读差异。为此,本文提出CEDAR——一个完全基于文化诱发情感反应的多模态基准。通过创新的自动化标注+人工验证流程,从海量数据中筛选出具有跨文化情感分歧的实例,最终构建包含10,962个样本的数据集,覆盖7种语言,每种语言含400个图文样本和1,166个纯文本样本,涵盖14种细粒度情绪类别。对17个代表性多语言模型的全面评估显示,语言一致性与文化对齐性存在明显分离,表明当前模型在真正理解文化语境下的情感表达方面仍面临重大挑战。

原文摘要 · Abstract (English)

Culture serves as a fundamental determinant of human affective processing and profoundly shapes how individuals perceive and interpret emotional stimuli. Despite this intrinsic link extant evaluations regarding cultural alignment within Large Language Models primarily prioritize declarative knowledge such as geographical facts or established societal customs. These benchmarks remain insufficient to capture the subjective interpretative variance inherent to diverse sociocultural lenses. To address this limitation, we introduce CEDAR, a multimodal benchmark constructed entirely from scenarios capturing Culturally \underline{\textsc{E}}licited \underline{\textsc{D}}istinct \underline{\textsc{A}}ffective \underline{\textsc{R}}esponses. To construct CEDAR, we implement a novel pipeline that leverages LLM-generated provisional labels to isolate instances yielding cross-cultural emotional distinctions, and subsequently derives reliable ground-truth annotations through rigorous human evaluation. The resulting benchmark comprises 10,962 instances across seven languages and 14 fine-grained emotion categories, with each language including 400 multimodal and 1,166 text-only samples. Comprehensive evaluations of 17 representative multilingual models reveal a dissociation between language consistency and cultural alignment, demonstrating that culturally grounded affective understanding remains a significant challenge for current models.

大模型评估跨文化理解情感分析多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。