arXiv:2503.12556cs.CLcs.AI2025-03被引 1

让大模型学会主动提问,弥补对话中个性化理解的差距。

From Guessing to Asking: An Approach to Resolving the Persona Knowledge Gap in LLMs during Multi-Turn Conversations

  • 通过动态检测不确定性和反馈优化,识别并修复对话中的个性认知缺口。
  • 在真实数据集上,人类更偏好其回复42%(电影推荐)和27%(心理支持)。
  • 特别适合长对话场景,提升连贯性和用户适配性,适合对话系统研发者。

多轮对话中,大语言模型面临保持连贯性同时适应用户特定信息的挑战。本文提出‘个性知识差距’概念,即模型内部理解与实现连贯个性化对话所需知识之间的差异。尽管已有研究关注此问题,但计算方法仍不充分。我们提出对话偏好引出与推荐框架(CPER),利用内在不确定性量化和反馈驱动优化,动态检测并解决该差距。CPER包含三个模块:上下文理解模块用于提取偏好,动态反馈模块衡量不确定性并优化个性匹配,个性驱动生成模块根据累积用户上下文调整回复。我们在两个真实数据集上评估:CCPE-M(偏好电影推荐)和ESConv(心理健康支持)。通过A/B测试,人类评估者对CPER回复的偏好度分别比基线高出42%和27%。定性评估确认,其回复在长对话(12+轮)中更具上下文相关性和连贯性。

原文摘要 · Abstract (English)

In multi-turn dialogues, large language models (LLM) face a critical challenge of ensuring coherence while adapting to user-specific information. This study introduces the persona knowledge gap, the discrepancy between a model's internal understanding and the knowledge required for coherent, personalized conversations. While prior research has recognized these gaps, computational methods for their identification and resolution remain underexplored. We propose Conversation Preference Elicitation and Recommendation (CPER), a novel framework that dynamically detects and resolves persona knowledge gaps using intrinsic uncertainty quantification and feedback-driven refinement. CPER consists of three key modules: a Contextual Understanding Module for preference extraction, a Dynamic Feedback Module for measuring uncertainty and refining persona alignment, and a Persona-Driven Response Generation module for adapting responses based on accumulated user context. We evaluate CPER on two real-world datasets: CCPE-M for preferential movie recommendations and ESConv for mental health support. Using A/B testing, human evaluators preferred CPER's responses 42% more often than baseline models in CCPE-M and 27% more often in ESConv. A qualitative human evaluation confirms that CPER's responses are preferred for maintaining contextual relevance and coherence, particularly in longer (12+ turn) conversations.

对话系统个性建模大模型优化用户适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。