arXiv:2604.01599cs.AI2026-04被引 2

让大模型自己管理记忆,提升长程推理的准确性与可靠性。

ByteRover: Agent-Native Memory Through LLM-Curated Hierarchical Context

  • 大模型自主构建分层知识树,直接控制记忆的组织与更新。
  • 在LoCoMo上达顶尖准确率,检索延迟低于100毫秒,无需外部服务。
  • 适合需要高可靠记忆、无外部依赖的智能体系统开发者。

记忆增强生成(MAG)通过外部记忆扩展大语言模型的长上下文推理能力,但现有方法将记忆视为独立服务,由分块、嵌入、图谱提取等分离管道处理。这种架构导致存储系统不理解内容,造成语义漂移、跨代理协调上下文丢失、故障后恢复脆弱等问题。本文提出ByteRover,一种代理原生记忆架构,反转记忆流程:执行任务的同一LLM负责知识的编排、结构化与检索。知识以分层上下文树形式表示,分为领域、主题、子主题和条目,每条目含显式关系、来源及自适应知识生命周期(AKL),包含重要性评分、成熟度层级和时效衰减。检索采用五级渐进策略,90%以上查询可在100毫秒内完成且无需调用LLM,仅对新问题才触发代理推理。在LoCoMo和LongMemEval上的实验表明,ByteRover在LoCoMo上达到当前最优准确率,在LongMemEval上表现优异,同时无需外部基础设施,不依赖向量数据库、图数据库或嵌入服务,所有知识以可读的Markdown文件本地存储。

原文摘要 · Abstract (English)

Memory-Augmented Generation (MAG) extends large language models with external memory to support long-context reasoning, but existing approaches universally treat memory as an external service that agents call into, delegating storage to separate pipelines of chunking, embedding, and graph extraction. This architectural separation means the system that stores knowledge does not understand it, leading to semantic drift between what the agent intended to remember and what the pipeline actually captured, loss of coordination context across agents, and fragile recovery after failures. In this paper, we propose ByteRover, an agent-native memory architecture that inverts the memory pipeline: the same LLM that reasons about a task also curates, structures, and retrieves knowledge. ByteRover represents knowledge in a hierarchical Context Tree, a file-based knowledge graph organized as Domain, Topic, Subtopic, and Entry, where each entry carries explicit relations, provenance, and an Adaptive Knowledge Lifecycle (AKL) with importance scoring, maturity tiers, and recency decay. Retrieval uses a 5-tier progressive strategy that resolves most queries at sub-100 ms latency without LLM calls, escalating to agentic reasoning only for novel questions. Experiments on LoCoMo and LongMemEval demonstrate that ByteRover achieves state-of-the-art accuracy on LoCoMo and competitive results on LongMemEval while requiring zero external infrastructure, no vector database, no graph database, no embedding service, with all knowledge stored as human-readable markdown files on the local filesystem.

记忆机制大模型知识图谱推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。