构建文化对齐数据集,提升大模型回应的多样性与敏感性。
AlignCultura: Towards Culturally Aligned Large Language Models?

- 分两阶段构建基于联合国教科文组织文化的对齐数据集
- 微调模型使三重标准整体表现提升4%-6%,错误减少18%
- 适合关注文化多样性与伦理对齐的研究者和开发者
大型语言模型的文化对齐对于生成情境感知、尊重且可信的输出至关重要。缺乏文化对齐可能导致模型产生刻板印象、不敏感或误导性回答,无法体现文化多样性,违背有益、无害、诚实(HHH)原则。现有基准尚不足以系统评估文化对齐,尤其未遵循联合国教科文组织关于文化多样性的理念。为此,我们提出Align-Cultura,一个两阶段文化对齐流程。第一阶段构建CULTURAX——基于联合国教科文组织文化分类体系的英文HHH数据集,通过查询重构、扩展代表性不足领域、并利用SimHash防止数据泄露;随后通过双阶段拒绝采样生成文化根基明确的回复。最终数据集包含1,500个样本,覆盖30个有形与无形文化子领域。第二阶段在通用模型、文化微调模型及开源模型(Qwen3-8B、DeepSeek-R1-Distill-Qwen-7B)上进行基准测试。实证表明,文化微调模型在联合HHH表现上提升4%-6%,文化失误减少18%,效率提升10%-12%,数据泄露控制在0.3%以内。
原文摘要 · Abstract (English)
Cultural alignment in Large Language Models (LLMs) is essential for producing contextually aware, respectful, and trustworthy outputs. Without it, models risk generating stereotyped, insensitive, or misleading responses that fail to reflect cultural diversity w.r.t Helpful, Harmless, and Honest (HHH) paradigm. Existing benchmarks represent early steps toward cultural alignment; yet, no benchmarks currently enables systematic evaluation of cultural alignment in line with UNESCO's principles of cultural diversity w.r.t HHH paradigm. Therefore, to address this gap, we built Align-Cultura, two-stage pipeline for cultural alignment. Stage I constructs CULTURAX, the HHH-English dataset grounded in the UNESCO cultural taxonomy, through Query Construction, which reclassifies prompts, expands underrepresented domains (or labels), and prevents data leakage with SimHash. Then, Response Generation pairs prompts with culturally grounded responses via two-stage rejection sampling. The final dataset contains 1,500 samples spanning 30 subdomains of tangible and intangible cultural forms. Stage II benchmarks CULTURAX on general-purpose models, culturally fine-tuned models, and open-weight LLMs (Qwen3-8B and DeepSeek-R1-Distill-Qwen-7B). Empirically, culturally fine-tuned models improve joint HHH by 4%-6%, reduce cultural failures by 18%, achieve 10%-12% efficiency gains, and limit leakage to 0.3%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。