让大模型推理更稳更快,避免走偏和浪费算力。
MAXS: Meta-Adaptive Exploration with LLM Agents
- 用前瞻策略预判工具使用价值,提升决策质量。
- 结合步骤一致性和趋势斜率,选出稳定高效的推理路径。
- 自动停止冗余计算,适合需要高可靠性的多工具任务。
大型语言模型(LLM)代理通过多工具协作展现内在推理能力。然而,在代理推理过程中,现有方法常面临(i)局部短视生成问题,因缺乏前瞻规划;(ii)轨迹不稳定性,早期微小错误可能导致推理路径严重偏离。这使得全局有效性与计算效率难以兼顾。为此,我们提出基于大模型代理的元自适应探索框架MAXS,灵活融合工具执行与推理规划。MAXS采用前瞻策略,提前数步扩展推理路径,评估工具使用的优势值,并结合步骤一致性方差与跨步趋势斜率,共同选择稳定、一致且高价值的推理步骤。此外,引入轨迹收敛机制,在路径一致性达成后停止进一步展开,控制计算成本,实现多工具推理中资源效率与全局有效性的平衡。我们在三个基础模型(MiMo-VL-7B, Qwen2.5-VL-7B, Qwen2.5-VL-32B)和五个数据集上进行大量实验,结果表明MAXS在性能和推理效率上均持续优于现有方法。进一步分析证实了前瞻策略与工具使用有效性。
原文摘要 · Abstract (English)
Large Language Model (LLM) Agents exhibit inherent reasoning abilities through the collaboration of multiple tools. However, during agent inference, existing methods often suffer from (i) locally myopic generation, due to the absence of lookahead, and (ii) trajectory instability, where minor early errors can escalate into divergent reasoning paths. These issues make it difficult to balance global effectiveness and computational efficiency. To address these two issues, we propose meta-adaptive exploration with LLM agents https://github.com/exoskeletonzj/MAXS, a meta-adaptive reasoning framework based on LLM Agents that flexibly integrates tool execution and reasoning planning. MAXS employs a lookahead strategy to extend reasoning paths a few steps ahead, estimating the advantage value of tool usage, and combines step consistency variance and inter-step trend slopes to jointly select stable, consistent, and high-value reasoning steps. Additionally, we introduce a trajectory convergence mechanism that controls computational cost by halting further rollouts once path consistency is achieved, enabling a balance between resource efficiency and global effectiveness in multi-tool reasoning. We conduct extensive empirical studies across three base models (MiMo-VL-7B, Qwen2.5-VL-7B, Qwen2.5-VL-32B) and five datasets, demonstrating that MAXS consistently outperforms existing methods in both performance and inference efficiency. Further analysis confirms the effectiveness of our lookahead strategy and tool usage.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。