提出经验压缩谱框架,统一记忆、技能与规则的管理方式。
Experience Compression Spectrum: Unifying Memory, Skills, and Rules in LLM Agents
- 将记忆、技能、规则视为压缩程度递增的连续体,降低计算开销。
- 发现现有系统压缩率固定,缺乏跨层级自适应能力,存在‘缺失对角线’空白。
- 适合长期部署的大型语言模型智能体开发者与研究者参考。
随着大语言模型智能体在长周期、多会话场景下的扩展,高效管理累积经验成为关键瓶颈。记忆系统与技能发现均旨在从交互轨迹中提取可复用知识,但对22篇主要论文共1,136篇引用的引文分析显示,跨社区引用率低于1%。本文提出‘经验压缩谱’框架,将记忆、技能和规则置于压缩程度递增的单一轴线上(情景记忆压缩5–20倍,程序性技能50–500倍,陈述性规则超1,000倍),直接减少上下文消耗、检索延迟与计算开销。将20多个系统映射到该谱系后发现,所有系统均运行于固定的预设压缩层级,无支持自适应跨层级压缩的能力,这一缺口被称为‘缺失对角线’。进一步表明,仅靠专业化不足(两个领域独立解决共性子问题但未共享方案)、评估方法紧密绑定压缩层级、迁移性随压缩提升而增强但特异性下降,且知识生命周期管理仍被忽视。本文提出可扩展全谱智能体学习系统的关键开放问题与设计原则。
原文摘要 · Abstract (English)
As LLM agents scale to long-horizon, multi-session deployments, efficiently managing accumulated experience becomes a critical bottleneck. Agent memory systems and agent skill discovery both address this challenge, extracting reusable knowledge from interaction traces, yet a citation analysis of 1{,}136 references across 22 primary papers reveals a cross-community citation rate below 1\%. We propose the \emph{Experience Compression Spectrum}, a unifying framework that positions memory, skills, and rules as points along a single axis of increasing compression (5--20$\times$ for episodic memory, 50--500$\times$ for procedural skills, 1{,}000$\times$+ for declarative rules), directly reducing context consumption, retrieval latency, and compute overhead. Mapping 20+ systems onto this spectrum reveals that every system operates at a fixed, predetermined compression level: none supports adaptive cross-level compression, a gap we term the \emph{missing diagonal}. We further show that specialization alone is insufficient (both communities independently solve shared sub-problems without exchanging solutions), that evaluation methods are tightly coupled to compression levels, that transferability increases with compression at the cost of specificity, and that knowledge lifecycle management remains largely neglected. We articulate open problems and design principles for scalable, full-spectrum agent learning systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。