arXiv:2507.07957cs.CLcs.AI2025-07被引 152

MIRIX让AI能像人一样长期记忆并理解多模态信息。

MIRIX: Multi-Agent Memory System for LLM-Based Agents

  • 六类记忆模块+多智能体框架,实现跨模态长期记忆管理
  • 在截图问答任务中准确率比基线高35%,存储减少99.9%
  • 支持实时屏幕监控与本地隐私存储,适合个性化助手场景

尽管人工智能代理的记忆能力日益受到关注,现有方案仍存在根本局限。多数依赖扁平化、范围狭窄的记忆组件,难以实现个性化、抽象化及长期可靠地回忆用户信息。为此,我们提出MIRIX——一种模块化多智能体记忆系统,重新定义AI记忆的未来。MIRIX突破纯文本限制,融合丰富视觉与多模态体验,使记忆真正适用于现实场景。系统包含六类精心设计的记忆类型:核心记忆、情景记忆、语义记忆、程序记忆、资源记忆与知识库,并通过多智能体框架动态协调更新与检索。该设计使代理能够规模化持久存储、推理并精准召回多样化的长期用户数据。我们在两个严苛场景中验证MIRIX:首先,在包含近20,000张高分辨率计算机截图的ScreenshotVQA多模态基准上,要求深度上下文理解,且无现有记忆系统可适用,MIRIX相比RAG基线准确率提升35%,存储需求降低99.9%;其次,在单模态文本输入的长对话基准LOCOMO上,达到85.4%的顶尖性能,远超现有基线。结果表明,MIRIX为增强型大模型代理树立了新标准。为便于体验,我们提供基于MIRIX的封装应用,实时监控屏幕,构建个性化记忆库,并提供直观可视化与安全本地存储,保障隐私。

原文摘要 · Abstract (English)

Although memory capabilities of AI agents are gaining increasing attention, existing solutions remain fundamentally limited. Most rely on flat, narrowly scoped memory components, constraining their ability to personalize, abstract, and reliably recall user-specific information over time. To this end, we introduce MIRIX, a modular, multi-agent memory system that redefines the future of AI memory by solving the field's most critical challenge: enabling language models to truly remember. Unlike prior approaches, MIRIX transcends text to embrace rich visual and multimodal experiences, making memory genuinely useful in real-world scenarios. MIRIX consists of six distinct, carefully structured memory types: Core, Episodic, Semantic, Procedural, Resource Memory, and Knowledge Vault, coupled with a multi-agent framework that dynamically controls and coordinates updates and retrieval. This design enables agents to persist, reason over, and accurately retrieve diverse, long-term user data at scale. We validate MIRIX in two demanding settings. First, on ScreenshotVQA, a challenging multimodal benchmark comprising nearly 20,000 high-resolution computer screenshots per sequence, requiring deep contextual understanding and where no existing memory systems can be applied, MIRIX achieves 35% higher accuracy than the RAG baseline while reducing storage requirements by 99.9%. Second, on LOCOMO, a long-form conversation benchmark with single-modal textual input, MIRIX attains state-of-the-art performance of 85.4%, far surpassing existing baselines. These results show that MIRIX sets a new performance standard for memory-augmented LLM agents. To allow users to experience our memory system, we provide a packaged application powered by MIRIX. It monitors the screen in real time, builds a personalized memory base, and offers intuitive visualization and secure local storage to ensure privacy.

多智能体记忆系统多模态长程记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。