用自然语言调用规划工具,让大模型可靠完成复杂任务规划。
Toward PDDL Planning Copilot
- 通过MCP协议连接外部规划工具,用自然语言指令控制
- 在3个开源大模型上验证,性能远超无工具版本
- 小模型+专用工具胜过大商业模型,适合需要可靠规划的场景
大语言模型(LLMs)虽能执行复杂任务,但缺乏可靠的长程规划能力。本文提出规划协作者(Planning Copilot),一个集成多种规划工具的聊天机器人,用户可通过自然语言指令调用这些工具。该系统基于最新提出的模型上下文协议(Model Context Protocol, MCP),可兼容任何支持MCP的LLM,无需领域微调。Planning Copilot支持检查规划问题语法、选择合适规划器、调用规划器、验证生成计划及模拟执行等常见任务。我们使用三个开源LLM对其实证评估,结果表明其性能显著优于未使用工具的相同模型。此外,与近期商业模型Chat GPT-5的有限定性对比显示,尽管依赖更小的LLM,Planning Copilot仍表现更优。这表明专用规划工具是提升大模型规划能力的有效途径。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly being used as autonomous agents capable of performing complicated tasks. However, they lack the ability to perform reliable long-horizon planning on their own. This paper bridges this gap by introducing the Planning Copilot, a chatbot that integrates multiple planning tools and allows users to invoke them through instructions in natural language. The Planning Copilot leverages the Model Context Protocol (MCP), a recently developed standard for connecting LLMs with external tools and systems. This approach allows using any LLM that supports MCP without domain-specific fine-tuning. Our Planning Copilot supports common planning tasks such as checking the syntax of planning problems, selecting an appropriate planner, calling it, validating the plan it generates, and simulating their execution. We empirically evaluate the ability of our Planning Copilot to perform these tasks using three open-source LLMs. The results show that the Planning Copilot highly outperforms using the same LLMs without the planning tools. We also conducted a limited qualitative comparison of our tool against Chat GPT-5, a very recent commercial LLM. Our results shows that our Planning Copilot significantly outperforms GPT-5 despite relying on a much smaller LLM. This suggests dedicated planning tools may be an effective way to enable LLMs to perform planning tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。