arXiv:2509.04472cs.CLcs.AI2025-09Conference of the …被引 8

让对话更清晰:用重写提升大模型规划中的意图理解

RECAP: REwriting Conversations for Intent Understanding in Agentic Planning

  • 将模糊对话重写为简洁目标,提升规划准确性
  • 新数据集涵盖歧义、目标漂移等10类挑战场景
  • 适合研究多智能体对话与开放域规划的开发者

在由大型语言模型驱动的多智能体对话系统中,准确理解用户意图对有效规划至关重要。然而真实对话常存在模糊、不完整或动态变化等问题,传统分类方法难以泛化,导致规划失效。本文提出RECAP(REwriting Conversations for Agent Planning),一个用于评估和推动意图重写的基准,将用户-代理对话重构为用户目标的紧凑表示。该数据集涵盖歧义、意图漂移、模糊表达及混合目标等多样挑战。同时引入基于LLM的评估器,衡量重写后意图对下游规划的实用性。实验表明,基于提示的重写方法优于基线,在计划偏好上表现更优;进一步微调两种基于DPO的重写器可带来额外性能提升。结果表明,意图重写是改进开放域对话系统中智能体规划的关键且可行环节。

原文摘要 · Abstract (English)

Understanding user intent is essential for effective planning in conversational assistants, particularly those powered by large language models (LLMs) coordinating multiple agents. However, real-world dialogues are often ambiguous, underspecified, or dynamic, making intent detection a persistent challenge. Traditional classification-based approaches struggle to generalize in open-ended settings, leading to brittle interpretations and poor downstream planning. We propose RECAP (REwriting Conversations for Agent Planning), a new benchmark designed to evaluate and advance intent rewriting, reframing user-agent dialogues into concise representations of user goals. RECAP captures diverse challenges such as ambiguity, intent drift, vagueness, and mixed-goal conversations. Alongside the dataset, we introduce an LLM-based evaluator that assesses planning utility given the rewritten intent. Using RECAP, we develop a prompt-based rewriting approach that outperforms baselines, in terms of plan preference. We further demonstrate that fine-tuning two DPO-based rewriters yields additional utility gains. Our results highlight intent rewriting as a critical and tractable component for improving agentic planning in open-domain dialogue systems.

对话重写意图理解多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。