arXiv:2605.14420cs.AI2026-05ACL被引 1

用多维人口特征精准对齐价值观,提升大模型的多样性适配能力。

DVMap: Fine-Grained Pluralistic Value Alignment via High-Consensus Demographic-Value Mapping

论文配图:DVMap: Fine-Grained Pluralistic Value Alignment via High-Consensus Demographic-Value Mapping
图 1 · 摘自论文原文
  • 基于人口特征构建高共识价值观语料库,细化价值对齐粒度。
  • 在跨群体测试中,模型准确率达48.6%,优于DeepSeek-v3.2的45.1%。
  • 适用于需要精细化文化适配的AI系统开发与评估。

当前大语言模型通常依赖粗粒度的国家标签进行多元价值观对齐,但宏观监督常掩盖国内价值差异,导致对齐松散。本文提出DVMap框架,将监督方式从国家层面转向多维人口约束,以识别具有可预测高共识价值偏好的群体。通过严格保留相同人口特征下价值偏好一致的受访者,构建包含56,152条样本的高质量对齐语料库。在此基础上,引入结构化思维链机制引导模型推理人口-价值关联,并采用组相对策略优化(GRPO)实现价值分布的自适应锚定。为验证泛化能力,建立涵盖跨人口、跨国家、跨价值的三重泛化基准,共含21,553个样本。实验表明,DVMap能有效学习人口到价值的复杂映射,在跨群体测试中,Qwen3-8B-DVMap达到48.6%准确率,超越开源模型DeepSeek-v3.2的45.1%。代码与数据集已公开。

原文摘要 · Abstract (English)

Current Large Language Models (LLMs) typically rely on coarse-grained national labels for pluralistic value alignment. However, such macro-level supervision often obscures intra-country value heterogeneity, yielding a loose alignment. We argue that resolving this limitation requires shifting from national labels to multi-dimensional demographic constraints, which can identify groups with predictable, high-consensus value preference. To this end, we propose DVMap (High-Consensus Demographic-Value Mapping), a framework for fine-grained pluralistic value alignment. In this framework, we first present a demographic archetype extraction strategy to construct a high-quality value alignment corpus of 56,152 samples from the World Values Survey (WVS) by strictly retaining respondents with consistent value preferences under identical demographics. Over this corpus, we introduce a Structured Chain-of-Thought (CoT) mechanism that explicitly guides LLMs to reason about demographic-value correlations. Subsequently, we employ Group Relative Policy Optimization (GRPO) to achieve adaptive anchoring of value distributions. To rigorously evaluate generalization, we further establish a triple-generalization benchmark (spanning cross-demographic, cross-country, and cross-value) comprising 21,553 samples. Experimental results demonstrate that DVMap effectively learns the manifold mapping from demographics to values, exhibiting strong generalization and robustness. On cross-demographic tests, Qwen3-8B-DVMap achieves 48.6% accuracy, surpassing the advanced open-source LLM DeepSeek-v3.2 (45.1%). The source code and dataset are available at https://github.com/EnlightenedAI/DVMap.

价值观对齐人口特征大模型多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。