arXiv:2501.01031cs.CLcs.AI2025-01AAAI被引 13

用动态检索提升大模型文化对齐,避免西方中心偏见。

ValuesRAG: Enhancing Cultural Alignment Through Retrieval-Augmented Contextual Learning

  • 基于WVS数据生成个体价值观摘要,动态检索匹配文化背景
  • 在6个区域数据集上优于零样本、角色扮演等方法
  • 适合需要跨文化公平性的AI系统开发者

确保大语言模型的文化价值对齐仍是关键挑战,因其训练数据常包含西方中心偏见,导致跨文化应用中出现误表和公平性问题。现有方法如角色设定与少样本学习受限于预训练知识,可扩展性差且难以捕捉细微文化差异。为此,我们提出ValuesRAG框架,结合检索增强生成(RAG)与上下文学习(ICL),在文本生成过程中动态融入文化与人口统计知识。利用世界价值观调查(WVS)数据集,首先生成个体价值观摘要;随后构建多个代表性区域数据集作为测试集,根据人口特征检索相关价值观摘要,并通过重排序选择前k个最相关摘要。在6个不同区域数据集上评估显示,ValuesRAG始终优于基线方法,包括零样本、角色分配、少样本及混合方法,在主实验与消融实验中均表现最优。结果表明该方法能有效促进文化对齐与包容性AI系统的构建,凸显动态检索在弥合全球大模型能力与本地文化价值间差距的潜力。

原文摘要 · Abstract (English)

Ensuring cultural values alignment in Large Language Models (LLMs) remains a critical challenge, as these models often embed Western-centric biases from their training data, leading to misrepresentations and fairness concerns in cross-cultural applications. Existing approaches such as role assignment and few-shot learning struggle to address these limitations effectively due to their reliance on pre-trained knowledge, limited scalability, and inability to capture nuanced cultural values. To address these issues, we propose ValuesRAG, a novel and effective framework that applies Retrieval-Augmented Generation (RAG) with In-Context Learning (ICL) to integrate cultural and demographic knowledge dynamically during text generation. Leveraging the World Values Survey (WVS) dataset, ValuesRAG first generates summaries of values for each individual. We subsequently curate several representative regional datasets to serve as test datasets and retrieve relevant summaries of values based on demographic features, followed by a reranking step to select the top-k relevant summaries. We evaluate ValuesRAG using 6 diverse regional datasets and show that it consistently outperforms baselines: including zero-shot, role-assignment, few-shot, and hybrid methods, both in main experiments and ablation settings. Notably, ValuesRAG achieves the best overall performance over prior methods, demonstrating its effectiveness in fostering culturally aligned and inclusive AI systems. Our findings underscore the potential of dynamic retrieval-based methods to bridge the gap between global LLM capabilities and localized cultural values.

文化对齐RAG大模型伦理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。