arXiv:2603.21321cs.AIcs.CL2026-03被引 6

让AI在系统优化中持续进化,突破记忆和思维局限。

Improving Coherence and Persistence in Agentic AI for System Optimization

  • 分阶段生成多个智能体,每轮独立探索并记录成果
  • 通过档案与摘要机制实现知识跨轮积累,性能显著提升
  • 适合需要长期迭代优化的系统设计场景

设计高性能系统启发式算法是一个创造性的迭代过程,需专家提出假设并执行多步概念转变。尽管大语言模型(LLMs)在自动化这一循环中展现出潜力,但在复杂系统问题上仍因两大缺陷而受限:演化邻域偏差与连贯性天花板。演化方法常因依赖标量基准分数而陷入局部最优,无法应对需要协同多步调整的问题。现有代理框架则在长时程运行中面临上下文退化或无法在独立运行间累积知识。我们提出Engram——一种代理型研究者架构,通过将长时程探索与单个上下文窗口的限制解耦来解决上述问题。Engram将探索组织为一系列智能体,依次完成机制设计、测试与分析。每轮结束后,智能体将代码快照、日志和结果存入持久化档案,并将高层建模洞察提炼为紧凑的持久化研究摘要。后续智能体从全新上下文窗口开始,读取研究摘要以继承前期发现。实验表明,Engram在多云组播、LLM推理请求路由以及自然语言查询下数据库KV缓存重用优化等多样化领域均表现更优。

原文摘要 · Abstract (English)

Designing high-performance system heuristics is a creative, iterative process requiring experts to form hypotheses and execute multi-step conceptual shifts. While Large Language Models (LLMs) show promise in automating this loop, they struggle with complex system problems due to two critical failure modes: evolutionary neighborhood bias and the coherence ceiling. Evolutionary methods often remain trapped in local optima by relying on scalar benchmark scores, failing when coordinated multi-step changes are required. Conversely, existing agentic frameworks suffer from context degradation over long horizons or fail to accumulate knowledge across independent runs. We present Engram, an agentic researcher architecture that addresses these limitations by decoupling long-horizon exploration from the constraints of a single context window. Engram organizes exploration into a sequence of agents that iteratively design, test, and analyze mechanisms. At the conclusion of each run, an agent stores code snapshots, logs, and results in a persistent Archive and distills high-level modeling insights into a compact, persistent Research Digest. Subsequent agents then begin with a fresh context window, reading the Research Digest to build on prior discoveries. We find that Engram exhibits superior performance across diverse domains including multi-cloud multicast, LLM inference request routing, and optimizing KV cache reuse in databases with natural language queries.

智能体系统持续学习系统优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。