用树搜索构建智能体共享记忆,实现自主优化推理性能。
Arbor: Tree Search as a Cognition Layer for Autonomous Agents
- 构建显式搜索树作为多智能体共享工作内存,动态演化。
- 实现193%吞吐-延迟帕累托提升,远超单一智能体的33%。
- 适合需要跨栈协同优化的系统级研发团队使用。
Arbor是一个多智能体框架,将结构化树搜索作为自治智能体在大型状态化动作空间中的认知层。以往的自治优化系统针对孤立目标进行无状态评估,而Arbor通过维护一个带分值的假设搜索树作为智能体间的共享工作记忆,随每次测量动态演进,将失败视为诊断信号以重构后续探索,并随着先前成功改变瓶颈分布而扩展。我们在全栈LLM推理优化任务中验证了Arbor的有效性,该领域历史上需应用、框架、编译器、内核和硬件团队的协同努力才能达最优性能。Arbor由调度智能体(驱动各推理栈领域专家)和批评智能体(通过根因分析、自我反思和测量验证保障稳定性)构成,形成制衡架构,任一智能体无法单独主导系统。智能体能力分解为硬技能(领域专长)与软技能(协作协议),实现完全自主的多日优化任务。Arbor相较厂商优化基线最高提升193%的吞吐-延迟帕累托表现,而单个智能体则仅达+33%吞吐提升且数小时内崩溃;方法可泛化至多代硬件平台,运行间波动在2个百分点以内,表明其硬件无关且可复现。
原文摘要 · Abstract (English)
Arbor is a multi-agent framework that introduces structured tree search as a cognition layer for autonomous agents operating in large, stateful action spaces. Prior autonomous optimization systems operate on isolated targets with stateless evaluation. Arbor instead maintains an explicit search tree of scored hypotheses that serves as the shared working memory across agents, evolving with every measurement, treating failures as diagnostic signal that reshapes subsequent exploration, and expanding as prior successes shift the bottleneck distribution. We validate Arbor on full-stack LLM inference optimization, a domain where achieving peak performance has historically required coordinated effort from engineering teams across the application, framework, compiler, kernel, and hardware stack. Arbor pairs an Orchestrator agent, which drives optimization by delegating to Domain Specialists across the inference stack, with a Critic agent that safeguards stability through root-cause analysis, introspection, and measurement validation -- a checks-and-balances architecture where neither agent can unilaterally drive the system. Agent capabilities are decomposed into hard skills (domain expertise) and soft skills (coordination protocols that determine how contributions compose), enabling fully autonomous multi-day campaigns. Arbor achieves up to 193% inference throughput-latency Pareto improvement over vendor-optimized baselines, while a single agent without the harness plateaus at +33% throughput improvement and crashes irrecoverably within hours. Arbor generalizes to multiple generations of hardware platform, and run-to-run variance is within 2 percentage points demonstrating that the method is hardware-agnostic and reproducible.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。