通过融入人格特质提升大模型角色扮演能力
Orca: Enhancing Role-Playing Abilities of Large Language Models by Integrating Personality Traits
- 用大模型推断用户五大性格特质并生成个性化对话数据
- 在OrcaBench上表现优于现有模型,显著提升角色代入感
- 适合开发有个性的虚拟角色、社交类AI应用
大语言模型推动了个性化对话系统的发展,众多角色扮演对话代理应运而生。然而,以往研究多聚焦于通过设计角色档案提升模型指令遵循能力,忽视了驱动人类对话的心理因素。本文提出Orca框架,通过整合人格特质来构建定制化角色的大模型。该框架包含四个阶段:(1) 人格特质推断,利用大模型分析用户的五大性格特质报告与得分;(2) 数据增强,模拟用户的个人背景、故事及心理活动;(3) 数据集构建,采用人格条件指令提示(PCIP)激发模型响应;(4) 建模与训练,使用人格条件指令微调(PTIT和PSIT)方法,基于生成数据增强开源大模型。我们提出了OrcaBench,首个用于评估大模型在社交媒体平台生成内容质量的多尺度基准。实验表明,所提模型在该基准上表现优异,证明其在感知人格特质方面具有显著优势,大幅提升了角色扮演能力。代码已公开于https://github.com/Aipura/Orca。
原文摘要 · Abstract (English)
Large language models has catalyzed the development of personalized dialogue systems, numerous role-playing conversational agents have emerged. While previous research predominantly focused on enhancing the model's capability to follow instructions by designing character profiles, neglecting the psychological factors that drive human conversations. In this paper, we propose Orca, a framework for data processing and training LLMs of custom characters by integrating personality traits. Orca comprises four stages: (1) Personality traits inferring, leverage LLMs to infer user's BigFive personality trait reports and scores. (2) Data Augment, simulate user's profile, background story, and psychological activities. (3) Dataset construction, personality-conditioned instruction prompting (PCIP) to stimulate LLMs. (4) Modeling and Training, personality-conditioned instruction tuning (PTIT and PSIT), using the generated data to enhance existing open-source LLMs. We introduce OrcaBench, the first benchmark for evaluating the quality of content generated by LLMs on social platforms across multiple scales. Our experiments demonstrate that our proposed model achieves superior performance on this benchmark, demonstrating its excellence and effectiveness in perceiving personality traits that significantly improve role-playing abilities. Our Code is available at https://github.com/Aipura/Orca.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。