让智能体组织持续积累经验并共享知识,提升任务完成的准确性与效率。
Forage V2: Knowledge Evolution and Transfer in Autonomous Agent Organizations
- 构建多轮协作的智能体组织,通过制度化机制保存和传递知识。
- 六轮迭代后知识条目增至54条,评估结果趋于稳定,覆盖率达266。
- 弱模型继承强模型知识后成本降50%,收敛速度翻倍,结果可复现。
在开放世界任务中,自主智能体常因无法正确认知目标空间范围而出现“盲点”问题。Forage V1通过独立评估者发现完成标准,并隔离规划与评估代码来缓解此问题。V2将单次任务升级为学习型组织:经验跨轮次累积,知识跨模型迁移,制度性防护防止知识退化。在网页抓取、API调用、数学推理三类任务中验证:经过六轮运行,知识条目从0增长至54,目标空间估计趋于稳定;弱模型(Sonnet)继承强模型(Opus)知识后,覆盖率差距从6.6个百分点缩小至1.1个百分点,成本从9.40美元降至5.13美元,平均收敛轮数由7.0降至4.5,且三个独立实验均得出一致的266这一目标估计值,表明组织知识能校准评估本身。V2的核心贡献是架构设计——通过审计分离、合约协议、组织记忆等制度,使任何新加入的智能体都更可靠。积累的经验具有组织性、模型无关性、可转移性,以可读文档形式存储,未来任一智能体均可继承,无论其提供商或能力水平如何。
原文摘要 · Abstract (English)
Autonomous agents operating in open-world tasks -- where the completion boundary is not given in advance -- face denominator blindness: they systematically underestimate the scope of the target space. Forage V1 addressed this through co-evolving evaluation (an independent Evaluator discovers what "complete" means) and method isolation (Evaluator and Planner cannot see each other's code). V2 extends the architecture from a single expedition to a learning organization: experience accumulates across runs, transfers across model capabilities, and institutional safeguards prevent knowledge degradation. We demonstrate two claims across three task types (web scraping, API queries, mathematical reasoning). Knowledge accumulation: over six runs, knowledge entries grow from 0 to 54, and denominator estimates stabilize as domain understanding deepens. Knowledge transfer: a weaker agent (Sonnet) seeded with a stronger agent's (Opus) knowledge narrows a 6.6pp coverage gap to 1.1pp, halves cost (9.40 to 5.13 USD), converges in half the rounds (mean 4.5 vs. 7.0), and three independent seeded runs arrive at exactly the same denominator estimate (266), suggesting organizational knowledge calibrates evaluation itself. V2's contribution is architectural: it designs institutions -- audit separation, contract protocols, organizational memory -- that make any agent more reliable upon entry. The accumulated experience is organizational, model-agnostic, and transferable, stored as readable documents that any future agent inherits regardless of provider or capability level.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。