用心理学框架生成用户行为理由,让语言模型更懂人心。
Improving Language Model Personas via Rationalization with Psychological Scaffolds
- 用大五人格等心理框架生成用户判断背后的理由
- 在观点和电影偏好预测中表现优于仅依赖人口统计的模型
- 合成理由效果接近人工撰写,适合个性化推荐场景
通过用户描述或人格设定来预测用户偏好和意见的语言模型正被广泛应用。然而,现有方法大多依赖用户的人口统计特征和/或过往判断,缺乏对用户判断背后原因的深入推理。本文提出PB&J(心理学行为与判断)框架,通过语言模型生成潜在的推理依据,解释用户为何做出特定判断。这些推理基于用户的经历、性格特质或信念,并借助大五人格、原始世界观信念等结构化心理学框架进行约束,使推理更具理论基础。在公众意见和电影偏好预测任务上的实验表明,加入PB&J推理的语言模型人格表现持续优于仅依赖人口统计或判断的模型,甚至超越默认链式思维(无理论支撑)。此外,其性能接近使用人工撰写推理的人格,证明了理论引导的合成推理具有可行性。
原文摘要 · Abstract (English)
Language models prompted with a user description or persona are being used to predict the user's preferences and opinions. However, existing approaches to building personas mostly rely on a user's demographic attributes and/or prior judgments, but not on any underlying reasoning behind a user's judgments. We introduce PB&J (Psychology of Behavior and Judgments), a framework that improves LM personas by incorporating potential rationales for why the user could have made a certain judgment. Our rationales are generated by a language model to explicitly reason about a user's behavior on the basis of their experiences, personality traits, or beliefs. Our method employs psychological scaffolds: structured frameworks such as the Big 5 Personality Traits or Primal World Beliefs to help ground the generated rationales in existing theories. Experiments on public opinion and movie preference prediction tasks demonstrate that language model personas augmented with PB&J rationales consistently outperform personas conditioned only on user demographics and / or judgments, including those that use a model's default chain-of-thought, which is not grounded in psychological theories. Additionally, our PB&J personas perform competitively with those using human-written rationales, suggesting the potential of synthetic rationales guided by existing theories.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。