让大模型自动分配预算,高效完成多阶段任务。
ZEBRA: Zero-shot Budgeted Resource Allocation for LLM Orchestration

- 用连续非线性背包问题建模,零样本动态分配各阶段预算。
- 在编码任务中,预算减半时仍保持94.4%的性能,优于直接分配。
- 适应不同任务结构,对估算误差鲁棒,适合多智能体系统部署。
随着自主智能体在固定预算下执行端到端任务,核心问题已从是否遵守预算,转向如何有效使用预算。现有方法通常在单个智能体内逐步控制推理或通过强化学习学习分配策略,但未解决多智能体流水线中推理时跨阶段预算分配的问题。本文提出ZEBRA,一种零样本框架,将多阶段预算分配建模为连续非线性背包问题:由大模型控制器估计各阶段效用曲线,通过拉格朗日乘子的水填法求解最优分配方案。加法与乘法聚合统一于同一求解器。在150个任务的APPS编码基准上,两种ZEBRA变体在所有指标上均优于LLM-direct(由大模型直接分配预算)。当预算为无约束支出的α=0.5时,ZEBRA恢复了94.4%的无约束质量,而LLM-direct仅为88.1%。该优势统计显著,并可迁移至其他任务:在三阶段HotpotQA流水线上,ZEBRA领先14.3个百分点,且分配结果对效用曲线估算噪声具有实证鲁棒性。在HotpotQA中,其分配方案趋近均衡,而APPS中则偏向精炼阶段,体现出对流水线结构的自适应能力。更广泛地,本文表明推理时轻量级算法引导可提升多智能体系统的经济行为。
原文摘要 · Abstract (English)
As autonomous agents increasingly execute end-to-end tasks under fixed monetary budgets, the pressing open question shifts from whether the budget is respected, to how to spend it effectively. Existing budget-aware methods typically control reasoning step-by-step within a single agent, or learn resource allocation policies via RL. None address how to split a budget across the composing phases of a multi-agent pipeline at inference time. We propose ZEBRA, a zero-shot framework that reduces multi-phase budget allocation to a continuous nonlinear knapsack problem: an LLM controller estimates per-phase utility curves, and a water-filling search on the Lagrange multiplier returns the per-phase split. Additive and multiplicative aggregations are unified under the same solver. On a $150$-task APPS coding benchmark, both ZEBRA variants outperform LLM-direct (budget allocation directly by an LLM) on every aggregate metric. At a budget of $α= 0.5$ of the unconstrained spend, ZEBRA recovers $94.4\%$ of unconstrained quality, versus $88.1\%$ for LLM-direct. The advantage is statistically significant and transfers beyond coding: on a $3$-phase HotpotQA pipeline, ZEBRA beats LLM-direct by $14.3$pp, with allocations empirically robust to curve-estimation noise. On HotpotQA, ZEBRA arrives at a different budget split (near-balanced) compared to the APPS one (skewed towards a refinement phase), showing adaptation to the pipeline structure. More broadly, we show that lightweight algorithmic guidance at inference time can improve the economic behavior of autonomous multi-agent systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。