用鲁迅作品训练大模型,让其不仅模仿语言,更还原深层思想。
Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMs
- 基于鲁迅17部文集设计四类训练任务,融合语言与思想模拟。
- 在语言准确性和观点理解上显著优于基线模型。
- 适合对文学人物建模、深度角色扮演感兴趣的学者和开发者。
以往的大型语言模型角色模拟方法多依赖基础个人信息或有限的角色对话数据,难以捕捉个体深层思维。本文以著名中国作家鲁迅为案例,提出CharacterBot模型,旨在复现其语言风格与独特思想模式。基于鲁迅的17部散文集,设计了四项训练任务:预训练聚焦外部语言结构与知识掌握;微调阶段包括多项选择题问答、生成式问答及风格迁移,分别对应鲁迅的内在思考与写作特征。为提升多任务学习效果,引入CharLoRA参数更新机制,由通用语言风格专家协同任务专用专家,共同学习语言风格与深层思想理解。在三项语言准确性与观点理解任务上的评估显示,该模型显著超越基线。本工作为深度人物角色模拟提供新思路,并强调伦理规范的重要性。
原文摘要 · Abstract (English)
Previous approaches to persona simulation large language models (LLMs) have typically relied on learning basic biographical information, or using limited role-play dialogue datasets to capture a character's responses. However, a holistic representation of an individual goes beyond surface-level facts or conversations to deeper thoughts and thinking. In this work, we introduce CharacterBot, a model designed to replicate both the linguistic patterns and distinctive thought patterns as manifested in the textual works of a character. Using Lu Xun, a renowned Chinese writer as a case study, we propose four training tasks derived from his 17 essay collections. These include a pre-training task focused on mastering external linguistic structures and knowledge, as well as three fine-tuning tasks: multiple-choice question answering, generative question answering, and style transfer, each aligning the LLM with Lu Xun's internal ideation and writing style. To optimize learning across these tasks, we introduce a CharLoRA parameter updating mechanism, where a general linguistic style expert collaborates with other task-specific experts to better study both the language style and the understanding of deeper thoughts. We evaluate CharacterBot on three tasks for linguistic accuracy and opinion comprehension, demonstrating that it significantly outperforms the baselines on our adapted metrics. We hope this work inspires future research on deep character persona simulation LLMs while considering the importance of ethical standards.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。