让智能体通过结构化经验图持续自我进化,解决长期能力提升难题。
EXG: Self-Evolving Agents with Experience Graphs

- 用关系图谱结构化存储成功与失败经验,支持实时复用。
- 在代码生成和推理任务中,性能与效率均优于现有方法。
- 可作为插件接入现有智能体,适合需要长期优化的场景。
基于大语言模型的智能体虽具备复杂推理能力,但多数部署后行为固化,执行中积累的知识难以系统性提升。为此,本文提出EXG——首个专为自演化智能体设计的经验图框架,将过往成功与失败以结构化、关系化方式组织。EXG支持在线执行时实时构建图谱,实现跨任务即时经验复用;也支持离线整合为外部记忆模块。该设计使其可作为即插即用组件,提升现有自演化智能体的解题质量与资源效率。在代码生成与推理基准测试中,EXG在在线与离线评估下均展现出更优的性能-效率权衡。结果表明,将经验建模为图结构,为可扩展、可迁移的自演化行为提供了原则性基础。
原文摘要 · Abstract (English)
Large language model (LLM)-based agents have demonstrated strong capabilities in complex reasoning and problem solving through multi-step interactions, yet most deployed agents remain behaviorally static, with knowledge acquired during execution rarely translating into systematic improvement over time. In response, a growing line of work on self-evolving agents explores how agents can improve through experience during deployment, but most existing approaches either rely on ad hoc reflection limited to single-task correction or adopt unstructured memory that accumulates fragmented experience with delayed usability. To address this limitation, we introduce EXG, an experience graph framework for self-evolving agents that explicitly organizes accumulated successes and failures into a structured, relational representation. EXG is the first experience graph designed for self-evolving agents, supporting both online, real-time graph growth during execution for immediate cross-task experience reuse, and offline reuse of a consolidated experience graph as an external memory module. This design also enables EXG to serve as a plug-and-play component for existing self-evolving agents, organizing prior experience into a unified experience graph and improving both solution quality and resource efficiency as deployment progresses. Extensive experiments across code generation and reasoning benchmarks show that EXG attains more favorable performance-efficiency trade-offs than reflection- and memory-based baselines in both online and offline evaluations. Our results suggest that structuring experience as a graph provides a principled foundation for scalable and transferable self-evolving agent behavior.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。