通过激活特定神经元,实现对大模型人格特质的精准调控。
Neuron-based Personality Trait Induction in Large Language Models
- 基于心理学五大性格维度构建评估数据集PersonalityBench
- 识别出与人格特质相关的神经元并实现无需训练的精细调控
- 效果接近微调模型,适合角色扮演等需要灵活人格控制的应用
大型语言模型在模拟多种人格特质方面已表现出色,这对角色扮演等应用至关重要。本文提出一种基于神经元的人格特质诱导方法,包含三大贡献:首先,构建了PersonalityBench——一个大规模数据集,用于识别和评估模型的人格特质,其基础为心理学中的五大性格维度;其次,利用该数据集,提出一种高效方法,通过考察某特质的对立面来识别模型中与人格相关的神经元;第三,开发了一种简单有效的诱导方法,通过调节这些神经元的值,实现无需训练即可对模型人格特质进行细粒度控制。大量实验验证了该方法的有效性,结果表明其性能可媲美微调模型,同时提供更高效、灵活的解决方案。所有资源已在GitHub开源:https://github.com/RUCAIBox/NPTI。
原文摘要 · Abstract (English)
Large language models (LLMs) have become increasingly proficient at simulating various personality traits, an important capability for supporting related applications (e.g., role-playing). To further improve this capacity, in this paper, we present a neuron-based approach for personality trait induction in LLMs, with three major technical contributions. First, we construct PersonalityBench, a large-scale dataset for identifying and evaluating personality traits in LLMs. This dataset is grounded in the Big Five personality traits from psychology and is designed to assess the generative capabilities of LLMs towards specific personality traits. Second, by leveraging PersonalityBench, we propose an efficient method for identifying personality-related neurons within LLMs by examining the opposite aspects of a given trait. Third, we develop a simple yet effective induction method that manipulates the values of these identified personality-related neurons. This method enables fine-grained control over the traits exhibited by LLMs without training and modifying model parameters. Extensive experiments validate the efficacy of our neuron identification and trait induction methods. Notably, our approach achieves comparable performance as fine-tuned models, offering a more efficient and flexible solution for personality trait induction in LLMs. We provide access to all the mentioned resources at https://github.com/RUCAIBox/NPTI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。