无需训练即可动态调控大模型人格,像数学运算一样组合性格特征。
PERSONA: Dynamic and Compositional Inference-Time Personality Control via Activation Vector Algebra
- 通过激活空间向量代数,直接操控模型人格方向。
- 在PersonalityBench上达9.60分,接近微调上限9.61分。
- 支持动态变化与多性格组合,适合需要灵活行为控制的场景。
当前大语言模型的人格控制方法依赖静态提示或昂贵微调,难以捕捉人类特质的动态与组合特性。我们提出PERSONA,一种无需训练的框架,通过直接操作激活空间中的人格向量,实现接近微调的效果。核心洞察是人格特质在模型表征空间中表现为可提取的、近似正交的方向,支持代数运算。该框架包含三个阶段:Persona-Base通过对比激活分析提取正交特质向量;Persona-Algebra利用向量运算(标量乘法调节强度,加法实现组合,减法抑制)实现精准控制;Persona-Flow在推理时动态组合向量,实现上下文感知适应。在PersonalityBench上,方法取得9.60的平均得分,几乎达到监督微调上限9.61,且无任何梯度更新。在新提出的Persona-Evolve动态人格适应基准上,跨多种模型家族最高赢得率达91%。结果表明,大模型人格的部分特性具有数学可操作性,为可解释、高效的行为控制开辟了新路径。
原文摘要 · Abstract (English)
Current methods for personality control in Large Language Models rely on static prompting or expensive fine-tuning, failing to capture the dynamic and compositional nature of human traits. We introduce PERSONA, a training-free framework that achieves fine-tuning level performance through direct manipulation of personality vectors in activation space. Our key insight is that personality traits appear as extractable, approximately orthogonal directions in the model's representation space that support algebraic operations. The framework operates through three stages: Persona-Base extracts orthogonal trait vectors via contrastive activation analysis; Persona-Algebra enables precise control through vector arithmetic (scalar multiplication for intensity, addition for composition, subtraction for suppression); and Persona-Flow achieves context-aware adaptation by dynamically composing these vectors during inference. On PersonalityBench, our approach achieves a mean score of 9.60, nearly matching the supervised fine-tuning upper bound of 9.61 without any gradient updates. On our proposed Persona-Evolve benchmark for dynamic personality adaptation, we achieve up to 91% win rates across diverse model families. These results provide evidence that aspects of LLM personality are mathematically tractable, opening new directions for interpretable and efficient behavioral control.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。