arXiv:2603.01438cs.CLcs.AI2026-03被引 2

让聊天角色实时跟随人格设定,提升模拟真实感

Enhancing Persona Following at Decoding Time via Dynamic Importance Estimation for Role-Playing Agents

  • 基于心理理论动态评估人格属性重要性
  • 推理时加权奖励,实现人格一致性提升30%以上
  • 无需标注数据,适合角色扮演类应用

角色扮演语言代理在社会学研究中的价值日益增长,依赖大模型实现。为提升社会模拟的真实性,这些代理需遵循由人物设定定义的人格特征,但现有方法——静态提示工程或昂贵微调——难以适应动态场景。心理学理论(如认知-情感人格系统)指出,人格对行为的影响具有情境依赖性,这凸显了自适应人格管理的必要性。为此,我们提出一种理论驱动的新方法,通过动态估计上下文相关的人格重要性,并将其融入加权奖励引导的解码过程,实现推理时的人格遵循。具体而言,我们构建了人格动态解码(PDD)框架,包含两个核心组件:(1) 人格重要性估计(PIE)模块,可无监督地动态量化人格属性的情境重要性;(2) 人格引导的推理时对齐(PIA)范式,利用重要性得分构建加权多目标奖励,调节生成概率。大量实验表明,该方法在话语一致性和行为忠实度上均有效。

原文摘要 · Abstract (English)

The utility of Role-Playing Language Agents in sociological research is growing alongside the adoption of Large Language Models. For realism in social simulation, these agents must adhere to their personas defined by character profiles, yet existing strategies-static prompt engineering or costly fine-tuning-fail to adapt personas to dynamic scenarios. Psychological theories, such as the Cognitive-Affective Personality Systems, provide a crucial explanation for this failure: a persona's influence on behavior is not static but varies with the scenarios. This context-dependence highlights the critical need for adaptive persona management. To address this gap, we propose a novel, theory-driven method that dynamically estimates context-dependent persona importance and integrates it into weighted reward-guided decoding, enabling inference-time persona following. Specifically, we introduce the Persona Dynamic Decoding (PDD) framework, which consists of two key components: (1) Persona Importance Estimation (PIE) module, which dynamically quantifies the contextual importance of persona attributes without requiring ground-truth supervision; and (2) Persona-Guided Inference-Time Alignment (PIA) paradigm, which leverages these importance scores to construct weighted multi-objective rewards and modulate generation probabilities during inference. Extensive experiments show the effectiveness of our method in utterance consistency and behavioral fidelity.

角色扮演人格建模动态解码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。