arXiv:2505.16610cs.CL2025-05EMNLP被引 12

让AI学会个性化共情,回应更贴合用户真实情绪。

From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment

  • 通过自我反思与迭代优化,让AI从通用回应进化为个性适配。
  • 实验显示,无效回应减少,模型输出与用户偏好差距缩小。
  • 适合需要深度情感交互的场景,如心理咨询、陪伴类应用。

有效的情感支持依赖于理解用户的情绪与需求,以在多轮对话中提供有意义的安慰。大型语言模型(LLMs)虽具备表达共情的潜力,但常给出泛化且千篇一律的回应,难以满足用户的特定需求。为此,我们提出一种自演化框架,帮助LLMs提升响应质量,更好地对齐用户在个人特质、情绪状态和具体情境下的隐性偏好。该框架包含两个阶段:(1) 情感支持经验获取,通过有限的情感支持对话数据微调,使模型具备基础支持能力;(2) 自我优化以实现个性化情感支持,模型利用自我反思与自我精炼生成个性化回应。通过预-后精炼回应间的迭代直接偏好优化,模型生成的回应能更准确反映用户隐性偏好。大量实验与评估表明,该方法显著提升了模型在情感支持任务中的表现,减少了无用回应,并缩小了用户偏好与模型输出之间的差异。

原文摘要 · Abstract (English)

Effective emotional support hinges on understanding users' emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often deliver generic and one-size-fits-all responses that fail to address users' specific needs. To tackle this issue, we propose a self-evolution framework designed to help LLMs improve their responses to better align with users' implicit preferences concerning user profiles (personalities), emotional states, and specific situations. Our framework consists of two distinct phases: \textit{(1)} \textit{Emotional Support Experience Acquisition}, where LLMs are fine-tuned on limited emotional support conversation data to provide basic support, and \textit{(2)} \textit{Self-Improvement for Personalized Emotional Support}, where LLMs leverage self-reflection and self-refinement to generate personalized responses. Through iterative direct preference optimization between the pre- and post-refined responses, our model generates responses that reflect a better understanding of the user's implicit preferences. Extensive experiments and evaluations demonstrate that our method significantly enhances the model's performance in emotional support, reducing unhelpful responses and minimizing discrepancies between user preferences and model outputs.

情感支持个性化自演化LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。