首个评估角色扮演代理在角色冲突中决策的基准,揭示其倾向服从对齐而非角色立场。
RoleCDE:Benchmarking and Mitigating Role-Alignment Trade-offs in Role-Playing Agents

- 构建包含2.4万例困境的多难度角色冲突评测集
- 发现主流模型在冲突时90%以上优先选择对齐道德决策
- 基于该基准微调可有效改善角色价值权衡能力
角色扮演代理(RPAs)广泛用于引导大语言模型(LLMs)保持角色一致性,但现有基准主要评估表面一致性,难以洞察角色价值与对齐约束冲突下的决策机制。为此,我们提出RoleCDE,首个针对角色特定价值观与对齐约束之间结构化冲突设计的评测基准。RoleCDE将角色认知决策建模为认知困境场景,联合评估角色-情境对齐、价值冲突解决与决策倾向。基准覆盖约8,000个多样化角色档案和情景,近24,000个困境实例,涵盖三个难度等级与八类角色。对多个主流LLMs的评估发现存在“角色价值解耦”现象:即使在明确角色设定下,当角色价值与对齐原则冲突时,代理仍系统性地优先选择符合对齐与道德的决策,此行为几乎不受困境难度影响,但在不同角色类别间差异显著。进一步实验表明,基于RoleCDE的微调能有效缓解该解耦问题,提升价值权衡推理能力,同时保持角色扮演一致性和通用推理性能。代码已开源。
原文摘要 · Abstract (English)
Role-playing agents(RPAs) are widely used to steer large language models(LLMs) toward role-consistent behavior, yet existing benchmarks mainly evaluate surface-level fidelity and offer limited insight into decision making under role-alignment value conflicts. To address this gap, we introduce RoleCDE, the first benchmark designed to evaluate RPAs under structured conflicts between role-specific values and alignment-oriented constraints. RoleCDE formulates role-aware decision making as cognitive dilemma scenarios, jointly evaluating role-scenario grounding, value conflict resolution, and decision tendencies. The benchmark is constructed at scale, covering approximately 8k diverse role profiles and scenarios and nearly 24k dilemma instances across three difficulty levels and eight role categories. Evaluation of several mainstream LLMs reveals a "Role Value Decoupling" phenomenon, where agents systematically default to alignment-and morality-consistent decisions rather than role-specific values when the two conflict, even under explicit role conditioning. This behavior is largely invariant to dilemma difficulty but varies substantially across role categories. We further show that RoleCDE-based fine-tuning effectively mitigates this decoupling by improving value trade-off reasoning, while preserving general role-playing fidelity and general reasoning performance. Code is available at: https://github.com/rabbitrose/RoleCDE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。