arXiv:2507.21389cs.AIcs.CL2025-07EMNLP被引 12

让大模型主动提问,弥补信息缺失,提升协作能力

Teaching Language Models To Gather Information Proactively

  • 设计新任务范式,训练模型主动识别信息缺口并提出针对性问题
  • 在自动评估中优于o3-mini 18%,人类评分偏好提升42%和28%
  • 适合需要深度交互的复杂任务场景,如咨询、科研协作

大型语言模型(LLMs)正被期待作为协作伙伴,通过多轮对话解决复杂模糊的问题。然而当前模型在真实场景中常表现被动,面对不完整或模糊的提示时仅做狭义澄清,无法主动获取关键缺失信息。本文提出一种新的任务范式——主动信息收集,要求模型识别上下文中的信息缺口,并通过精准提问获取用户隐含知识。为此,我们设计了一个可扩展的框架,生成部分指定的真实世界任务,隐藏关键信息以模拟真实模糊性。核心创新在于一种强化学习微调策略,奖励能获取真正新信息(如领域专长、细粒度需求)的问题。实验表明,训练后的Qwen-2.5-7B模型在自动评估指标上比o3-mini高出18%;更重要的是,人类评估显示其生成的澄清问题和最终方案分别获得42%和28%更高的偏好。结果表明,主动澄清显著提升了模型作为协作思维伙伴的能力。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly expected to function as collaborative partners, engaging in back-and-forth dialogue to solve complex, ambiguous problems. However, current LLMs often falter in real-world settings, defaulting to passive responses or narrow clarifications when faced with incomplete or under-specified prompts, falling short of proactively gathering the missing information that is crucial for high-quality solutions. In this work, we introduce a new task paradigm: proactive information gathering, where LLMs must identify gaps in the provided context and strategically elicit implicit user knowledge through targeted questions. To systematically study and train this capability, we design a scalable framework that generates partially specified, real-world tasks, masking key information and simulating authentic ambiguity. Within this setup, our core innovation is a reinforcement finetuning strategy that rewards questions that elicit genuinely new, implicit user information -- such as hidden domain expertise or fine-grained requirements -- that would otherwise remain unspoken. Experiments demonstrate that our trained Qwen-2.5-7B model significantly outperforms o3-mini by 18% on automatic evaluation metrics. More importantly, human evaluation reveals that clarification questions and final outlines generated by our model are favored by human annotators by 42% and 28% respectively. Together, these results highlight the value of proactive clarification in elevating LLMs from passive text generators to genuinely collaborative thought partners.

大模型协作主动提问信息补全强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。