arXiv:2410.03868cs.CL2024-10ACL被引 42

测试大模型对个体价值观的推理能力,发现其准确率仅55%-65%。

Can Language Models Reason about Individualistic Human Values and Preferences?

  • 构建IndieValueCatalog数据集,评估模型对个体价值观的推理能力。
  • 前沿大模型在预测个体价值判断时准确率仅55%-65%。
  • 个体价值观无法仅靠人口统计信息近似,适合关注公平与个性的研究者。

当前多元对齐呼吁AI系统应满足所有人的多样化需求,但多数方法依赖预设维度(如人口统计)分类,易忽视个体差异甚至造成刻板印象。为真实体现多样性并尊重个体性,我们提出个体化对齐,并引入IndieValueCatalog数据集——源自世界价值观调查(WVS),用于研究语言模型在个体价值观推理方面的表现。给定个人的价值陈述样本,模型需预测其在新情境下的价值判断。实验显示,前沿大模型在此任务上准确率仅为55%至65%。结果还表明,仅凭人口统计信息无法有效近似个体价值观。我们提出的值不平等指数(σInequity)揭示了模型在全球个体价值观推理中的偏见。此外,通过训练一系列IndieValueReasoner,我们发现了全球人类价值观的新模式与动态。

原文摘要 · Abstract (English)

Recent calls for pluralistic alignment emphasize that AI systems should address the diverse needs of all people. Yet, efforts in this space often require sorting people into fixed buckets of pre-specified diversity-defining dimensions (e.g., demographics), risking smoothing out individualistic variations or even stereotyping. To achieve an authentic representation of diversity that respects individuality, we propose individualistic alignment. While individualistic alignment can take various forms, we introduce IndieValueCatalog, a dataset transformed from the influential World Values Survey (WVS), to study language models (LMs) on the specific challenge of individualistic value reasoning. Given a sample of an individual's value-expressing statements, models are tasked with predicting this person's value judgments in novel cases. With IndieValueCatalog, we reveal critical limitations in frontier LMs, which achieve only 55 % to 65% accuracy in predicting individualistic values. Moreover, our results highlight that a precise description of individualistic values cannot be approximated only with demographic information. We also identify a partiality of LMs in reasoning about global individualistic values, as measured by our proposed Value Inequity Index (σInequity). Finally, we train a series of IndieValueReasoners to reveal new patterns and dynamics into global human values.

价值观推理个体化对齐大模型评估社会影响

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。