为大模型设计统一内存系统,让记忆可管理、可迁移、可演化。
MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models
- 构建统一内存抽象MemCube,整合参数、激活、文本三种记忆
- 支持跨任务追踪、融合与迁移,实现结构化记忆访问
- 适合需要持续学习与个性化智能的下一代AI系统
大语言模型(LLMs)已成为实现通用人工智能(AGI)的基础架构。尽管在语言感知与生成方面表现卓越,当前模型缺乏统一的内存处理机制,主要依赖参数化记忆(模型权重中的知识)和瞬时激活记忆(上下文限制的运行时状态)。虽然检索增强生成(RAG)引入了文本记忆,但缺乏生命周期管理和多模态集成能力,制约了长期知识演化。为此,我们提出MemOS,首个面向大模型的记忆操作系统,首次将记忆提升为第一类操作资源。它建立了统一的表示、组织与治理机制,覆盖参数、激活与文本三类核心记忆。核心是MemCube,一种标准化内存抽象,支持异构记忆的追踪、融合与迁移,并在任务与上下文中提供结构化、可追溯的访问。MemOS构建了以记忆为中心的执行框架,具备强可控性、高适应性与可演化性,填补了当前大模型基础设施的关键空白,为持续适应、个性化智能与跨平台协同奠定了基础。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have emerged as foundational infrastructure in the pursuit of Artificial General Intelligence (AGI). Despite their remarkable capabilities in language perception and generation, current LLMs fundamentally lack a unified and structured architecture for handling memory. They primarily rely on parametric memory (knowledge encoded in model weights) and ephemeral activation memory (context-limited runtime states). While emerging methods like Retrieval-Augmented Generation (RAG) incorporate plaintext memory, they lack lifecycle management and multi-modal integration, limiting their capacity for long-term knowledge evolution. To address this, we introduce MemOS, a memory operating system designed for LLMs that, for the first time, elevates memory to a first-class operational resource. It builds unified mechanisms for representation, organization, and governance across three core memory types: parametric, activation, and plaintext. At its core is the MemCube, a standardized memory abstraction that enables tracking, fusion, and migration of heterogeneous memory, while offering structured, traceable access across tasks and contexts. MemOS establishes a memory-centric execution framework with strong controllability, adaptability, and evolvability. It fills a critical gap in current LLM infrastructure and lays the groundwork for continual adaptation, personalized intelligence, and cross-platform coordination in next-generation intelligent systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。