用引用复制技术实现秒级创建有状态AI代理,大幅降低内存和延迟。
Aethon: A Reference-Based Replication Primitive for Constant-Time Instantiation of Stateful AI Agents
- 通过引用而非拷贝构建代理实例,实现近零时间创建。
- 支持多层继承与写时复制,有效管理代理状态和上下文。
- 适合大规模部署需快速生成、灵活管控的AI代理系统。
从无状态模型推理转向有状态智能体执行,正在重塑现代AI基础设施的系统假设。尽管大语言模型使持久化、工具使用和协作型智能体成为可能,现有运行时架构仍受限于高开销的实例化模式,带来显著延迟和内存消耗。本文提出Aethon,一种基于引用的复制原语,实现近乎常数时间的状态化AI智能体实例化。Aethon不将智能体重建为完整对象,而是将其表示为稳定定义、分层内存与本地上下文叠加的组合视图。通过将实例化从复制转变为引用,Aethon使创建成本与继承结构解耦。我们提出了Aethon的概念框架、系统架构与内存模型,包括分层继承与写时复制语义。分析其对复杂性、可扩展性、多智能体调度及企业治理的影响。我们认为,基于引用的实例化不仅是优化,更是生产级智能体软件更合适的系统抽象。Aethon指向一类新形态的AI基础设施:智能体成为轻量、可组合的执行身份,可规模化地生成、定制与治理。
原文摘要 · Abstract (English)
The transition from stateless model inference to stateful agentic execution is reshaping the systems assumptions underlying modern AI infrastructure. While large language models have made persistent, tool-using, and collaborative agents technically viable, existing runtime architectures remain constrained by materialization-heavy instantiation models that impose significant latency and memory overhead. This paper introduces Aethon, a reference-based replication primitive for near-constant-time instantiation of stateful AI agents. Rather than reconstructing agents as fully materialized objects, Aethon represents each instance as a compositional view over stable definitions, layered memory, and local contextual overlays. By shifting instantiation from duplication to reference, Aethon decouples creation cost from inherited structure. We present the conceptual framework, system architecture, and memory model underlying Aethon, including layered inheritance and copy-on-write semantics. We analyze its implications for complexity, scalability, multi-agent orchestration, and enterprise governance. We argue that reference-based instantiation is not merely an optimization, but a more appropriate systems abstraction for production-scale agentic software. Aethon points toward a new class of AI infrastructure in which agents become lightweight, composable execution identities that can be spawned, specialized, and governed at scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。