用多代理协作模拟文化调色,让大模型更懂不同国家的表达习惯。
Cultural Palette: Pluralising Culture Alignment via Multi-agent Palette
- 构建五洲文化调色板,用跨文化维度数据生成地区化对话样本。
- 五个区域代理分别生成本地化回复,再由元代理动态融合出最终结果。
- 适合需要跨文化适配的应用,如国际客服、全球化内容生成。
大型语言模型在生成任务中表现优异,但存在固有的单文化偏见,难以捕捉细微的文化语义差异。现有方法在微调后难以适应未知文化。受五大洲文化地理启发,我们提出 Cultural Palette 多代理框架,将文化对齐重构为可动态调整的“色彩混合”过程。首先,利用 GPT-4o 构建五色文化调色板数据集,结合霍夫斯泰德文化维度对大陆级对话进行精细化标注,建立基础文化表征。其次,五个大陆级对齐代理组成专业化文化社区,生成区域化初稿响应。最后,元代理通过文化 MoErges 动态融合这些文化‘色彩’,采用注意力门控参数合并机制,类似调色盘上颜料混合,既化解文化冲突又保留语义细腻度,输出最终文化适配响应。跨多国实验表明,Cultural Palette 在文化对齐效果上优于现有基线。
原文摘要 · Abstract (English)
Large language models (LLMs) face challenges in aligning with diverse cultural values despite their remarkable performance in generation, which stems from inherent monocultural biases and difficulties in capturing nuanced cultural semantics. Existing methods struggle to adapt to unknown culture after fine-tuning. Inspired by cultural geography across five continents, we propose Cultural Palette, a multi-agent framework that redefines cultural alignment as an adaptive "color-blending" process for country-specific adaptation. Our approach harnesses cultural geography across five continents through three key steps: First, we synthesize the Pentachromatic Cultural Palette Dataset using GPT-4o, refining continental-level dialogues with Hofstede's cultural dimensions to establish foundational cultural representations. Second, five continent-level alignment agents form specialized cultural communities that generate region-specific draft responses. Third, a Meta Agent employs Cultural MoErges to dynamically blend these cultural "colors" through attention-gated parameter merging, akin to mixing pigments on a palette, resolving conflicts while preserving cultural nuances to produce the final culturally-aligned response. Extensive experiments across various countries demonstrate that \textit{Cultural Palette} surpasses existing baselines in cultural alignment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。