用程序化提示优化大模型文化对齐,让回答更贴合目标群体价值观。
Prompt Programming for Cultural Bias and Alignment of Large Language Models
- 将提示视为可优化的程序,用DSPy自动调优文化相关表达。
- 在开源大模型上验证了文化偏差普遍存在,且提示优化能显著减少偏差。
- 适合关注AI伦理、跨文化应用和政策决策支持的研究者使用。
文化影响推理、价值判断、优先级设定和战略决策,但大语言模型常表现出文化偏差,与目标人群的价值观不符。随着大模型在战略决策、政策支持、文档摘要、分类及合规审计等任务中广泛应用,提升文化对齐度至关重要,以确保下游分析和建议反映目标群体的价值取向,而非模型默认偏好。已有研究提出基于社会调查的文化对齐框架,并证明文化特定提示可减少偏差,但主要针对闭源模型,依赖人工设计提示。本文在开源大模型上复现该框架的调研投影与距离度量,验证文化偏差是否存在以及文化引导是否仍有效。在此基础上,引入使用DSPy的提示编程方法,将提示视为可模块化、可优化的程序,通过优化文化距离目标来系统调优文化条件。实验表明,提示优化通常优于人工提示工程,说明使用DSPy进行提示编译是实现文化对齐更稳定、可迁移的路径。
原文摘要 · Abstract (English)
Culture shapes reasoning, values, prioritization, and strategic decision-making, yet large language models (LLMs) often exhibit cultural biases that misalign with target populations. As LLMs are increasingly used for strategic decision-making, policy support, and document engineering tasks such as summarization, categorization, and compliance-oriented auditing, improving cultural alignment is important for ensuring that downstream analyses and recommendations reflect target-population value profiles rather than default model priors. Previous work introduced a survey-grounded cultural alignment framework and showed that culture-specific prompting can reduce misalignment, but it primarily evaluated proprietary models and relied on manual prompt engineering. In this paper, we validate and extend that framework by reproducing its social sciences survey based projection and distance metrics on open-weight LLMs, testing whether the same cultural skew and benefits of culture conditioning persist outside closed LLM systems. Building on this foundation, we introduce use of prompt programming with DSPy for this problem-treating prompts as modular, optimizable programs-to systematically tune cultural conditioning by optimizing against cultural-distance objectives. In our experiments, we show that prompt optimization often improves upon cultural prompt engineering, suggesting prompt compilation with DSPy can provide a more stable and transferable route to culturally aligned LLM responses.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。