构建人格感知常识知识图谱,让AI对话更符合个人性格
PCoKG: Personality-aware Commonsense Reasoning with Debate
- 用大模型角色扮演+辩论机制生成人格相关常识数据
- 数据集含52.1万条三元组,提升对话一致性表现
- 适合做个性化对话系统的研究者和开发者
多数常识推理模型忽视人格特质影响,限制了其在个性化系统(如对话生成)中的应用。为此,我们提出人格感知常识知识图谱(PCoKG),一个包含521,316个四元组的结构化数据集。通过三位评估者对ATOMIC数据集中的事件进行评分与筛选,选取可能引发不同人格类型差异性推理的事件。知识图谱构建利用大语言模型(LLM)的角色扮演能力开展推理任务,并引入包含正方、反方和裁判的辩论机制,通过反馈循环迭代优化生成结果。从多角度评估数据集,并使用多种LLM基线进行微调与消融实验,验证其鲁棒性及构建流程有效性。基于LoRA的微调结果显示,模型性能与基础模型参数规模呈正相关。最终将PCoKG应用于基于人格的对话生成,显著提升了生成回复与参考输出的一致性。该工作弥合了常识推理与个体认知差异之间的鸿沟,推动更个性化、情境感知的AI系统发展。
原文摘要 · Abstract (English)
Most commonsense reasoning models overlook the influence of personality traits, limiting their effectiveness in personalized systems such as dialogue generation. To address this limitation, we introduce the Personality-aware Commonsense Knowledge Graph (PCoKG), a structured dataset comprising 521,316 quadruples. We begin by employing three evaluators to score and filter events from the ATOMIC dataset, selecting those that are likely to elicit diverse reasoning patterns across different personality types. For knowledge graph construction, we leverage the role-playing capabilities of large language models (LLMs) to perform reasoning tasks. To enhance the quality of the generated knowledge, we incorporate a debate mechanism consisting of a proponent, an opponent, and a judge, which iteratively refines the outputs through feedback loops. We evaluate the dataset from multiple perspectives and conduct fine-tuning and ablation experiments using multiple LLM backbones to assess PCoKG's robustness and the effectiveness of its construction pipeline. Our LoRA-based fine-tuning results indicate a positive correlation between model performance and the parameter scale of the base models. Finally, we apply PCoKG to persona-based dialogue generation, where it demonstrates improved consistency between generated responses and reference outputs. This work bridges the gap between commonsense reasoning and individual cognitive differences, enabling the development of more personalized and context-aware AI systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。