arXiv:2602.16192cs.AIcs.LG2026-02

提出高容量高速记忆存储新范式,避免信息丢失。

Revolutionizing Long-Term Memory in AI: New Horizons with High-Capacity and High-Speed Storage

  • 采用'先存后提取'策略,保留原始经验以灵活复用
  • 实验验证该方法可减少任务间知识丢失风险
  • 适合追求通用智能的AI系统研究者

秉持“以记忆赋能世界”的使命,本文探讨实现人工超智能(ASI)所必需的“记忆”设计。现有主流范式为“提取后存储”,即从经验中提取被认为有用的信息并仅保存这些内容,但此过程可能丢弃对特定任务有价值的隐性知识。为此,本文倡导“先存储后按需提取”的新思路,主张保留原始经验,以应对多样化任务需求,从而规避信息损失。此外,还提出两种潜在路径:从大量概率性经验中挖掘深层洞察,以及通过共享存储经验提升收集效率。尽管这些方法看似直观有效,但简单实验证明其确具潜力。最后,论文分析了制约此类方向研究的主要挑战,并提出未来研究议题。

原文摘要 · Abstract (English)

Driven by our mission of "uplifting the world with memory," this paper explores the design concept of "memory" that is essential for achieving artificial superintelligence (ASI). Rather than proposing novel methods, we focus on several alternative approaches whose potential benefits are widely imaginable, yet have remained largely unexplored. The currently dominant paradigm, which can be termed "extract then store," involves extracting information judged to be useful from experiences and saving only the extracted content. However, this approach inherently risks the loss of information, as some valuable knowledge particularly for different tasks may be discarded in the extraction process. In contrast, we emphasize the "store then on-demand extract" approach, which seeks to retain raw experiences and flexibly apply them to various tasks as needed, thus avoiding such information loss. In addition, we highlight two further approaches: discovering deeper insights from large collections of probabilistic experiences, and improving experience collection efficiency by sharing stored experiences. While these approaches seem intuitively effective, our simple experiments demonstrate that this is indeed the case. Finally, we discuss major challenges that have limited investigation into these promising directions and propose research topics to address them.

记忆机制通用智能经验存储

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。