PlanGEN通过动态选择算法提升复杂问题求解能力
PlanGEN: A Multi-Agent Framework for Generating Planning and Reasoning Trajectories for Complex Problem Solving
- 引入约束引导的迭代验证机制增强推理性能
- 在多个基准上提升4%~8%,最高达自然规划任务8%↑
- 适合需要复杂推理与自适应决策的AI系统开发者
现有智能体框架和推理算法在处理复杂规划问题时,常受限于计划验证不足或对实例复杂度变化缺乏适应性。许多方法仅进行任务级验证而忽略约束,或使用固定推理算法而未根据实例复杂度调整。为此,我们提出PlanGEN——一种模型无关且可扩展的多智能体框架,包含约束、验证与选择三个核心组件。该框架采用约束引导的迭代验证策略,显著提升Best of N、Tree-of-Thought及REBASE等推理算法的表现。其中,选择智能体根据实例复杂度动态优化算法选择,增强对复杂规划问题的适应性。实验表明,PlanGEN在多个基准测试中均超越最强基线,在NATURAL PLAN(约8%↑)、OlympiadBench(约4%↑)、DocFinQA(约7%↑)和GPQA(约1%↑)上达到当前最优结果。关键发现为:约束引导的迭代验证可有效提升推理算法性能,而自适应选择机制进一步推动复杂规划与推理表现。
原文摘要 · Abstract (English)
Recent agent frameworks and inference-time algorithms often struggle with complex planning problems due to limitations in verifying generated plans or reasoning and varying complexity of instances within a single task. Many existing methods for these tasks either perform task-level verification without considering constraints or apply inference-time algorithms without adapting to instance-level complexity. To address these limitations, we propose PlanGEN, a model-agnostic and easily scalable agent framework with three key components: constraint, verification, and selection agents. Specifically, our approach proposes constraint-guided iterative verification to enhance performance of inference-time algorithms--Best of N, Tree-of-Thought, and REBASE. In PlanGEN framework, the selection agent optimizes algorithm choice based on instance complexity, ensuring better adaptability to complex planning problems. Experimental results demonstrate significant improvements over the strongest baseline across multiple benchmarks, achieving state-of-the-art results on NATURAL PLAN ($\sim$8%$\uparrow$), OlympiadBench ($\sim$4%$\uparrow$), DocFinQA ($\sim$7%$\uparrow$), and GPQA ($\sim$1%$\uparrow$). Our key finding highlights that constraint-guided iterative verification improves inference-time algorithms, and adaptive selection further boosts performance on complex planning and reasoning problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。