arXiv:2509.23206cs.CLcs.AI2025-09被引 3

让大模型在多轮对话中自动跟踪进度并规划下一步,提升复杂任务执行能力。

PARL-MT: Learning to Call Functions in Multi-Turn Conversation with Progress Awareness

  • 构建对话摘要与未来规划的联合数据集,显式引入进度感知机制。
  • 在强化学习中融合进度感知,减少上下文冗余,任务成功率提升23%以上。
  • 适合需要多步决策的智能助手、自动化数据分析等场景。

大语言模型在单轮函数调用上表现优异,但现实应用如旅行规划或多阶段数据分析通常涉及多轮对话。此时,模型不仅需每步准确调用函数,还需具备进度感知能力——即总结历史交互并规划后续行动,以保证长周期任务的一致性执行。现有方法或把多轮任务拆解为孤立的单轮样本,忽略任务级规划;或采用端到端强化学习,存在冗余且缺乏显式的进度感知。为此,我们提出PARL-MT框架,通过(i)进度感知生成(PAG)管道,自动生成包含对话摘要与未来规划的数据集;(ii)进度感知引导的强化学习(PAG-RL)算法,将进度感知融入训练过程,减少上下文冗余,增强局部动作与全局目标的一致性。在两个公开基准上的实验表明,PARL-MT显著优于现有方法,验证了进度感知在提升多轮函数调用鲁棒性与效率方面的有效性。

原文摘要 · Abstract (English)

Large language models (LLMs) have achieved impressive success in single-turn function calling, yet real-world applications such as travel planning or multi-stage data analysis typically unfold across multi-turn conversations. In these settings, LLMs must not only issue accurate function calls at each step but also maintain progress awareness, the ability to summarize past interactions and plan future actions to ensure coherent, long-horizon task execution. Existing approaches, however, either reduce multi-turn training to isolated single-turn samples, which neglects task-level planning, or employ end-to-end reinforcement learning (RL) that struggles with redundancy and lacks explicit integration of progress awareness. To overcome these limitations, we introduce PARL-MT, a framework that explicitly incorporates progress awareness into LLM training for multi-turn function calling. PARL-MT combines (i) a Progress Awareness Generation (PAG) pipeline, which automatically constructs datasets coupling conversation summaries with future task planning, and (ii) a Progress Awareness-Guided Reinforcement Learning (PAG-RL) algorithm, which integrates progress awareness into RL training to reduce contextual redundancy and improve alignment between local actions and global task completion. Empirical results on two public benchmarks demonstrate that PARL-MT significantly outperforms existing methods, highlighting the effectiveness of progress awareness in enabling robust and efficient multi-turn function calling.

多轮对话函数调用进度感知强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。