arXiv:2501.07278cs.AI2025-01TPAMI被引 91

首次系统梳理大模型智能体的持续学习方法,构建可长期适应的AI系统蓝图。

Lifelong Learning of Large Language Model based Agents: A Roadmap

  • 分感知、记忆、行动三模块,构建持续学习智能体框架
  • 提出缓解灾难性遗忘、提升长期性能的关键机制
  • 适合关注AI长期演化与自适应能力的研究者

持续学习(又称终身学习或增量学习)是推动通用人工智能发展的关键,使系统能在动态环境中持续适应。尽管大语言模型在自然语言处理中表现卓越,现有基于大模型的智能体通常面向静态系统,缺乏随时间应对新挑战的适应能力。本文首次系统总结将持续学习融入大模型智能体的潜在技术路径。我们将其核心组件划分为三个模块:感知模块用于多模态输入融合,记忆模块用于存储和检索动态演化的知识,行动模块用于与动态环境进行具身交互。这些支柱共同支持持续适应,缓解灾难性遗忘,并提升长期性能。本综述为研究者和实践者开发大模型智能体的持续学习能力提供路线图,涵盖新兴趋势、评估指标及应用场景。相关文献与资源见:https://github.com/qianlima-lab/awesome-lifelong-llm-agent。

原文摘要 · Abstract (English)

Lifelong learning, also known as continual or incremental learning, is a crucial component for advancing Artificial General Intelligence (AGI) by enabling systems to continuously adapt in dynamic environments. While large language models (LLMs) have demonstrated impressive capabilities in natural language processing, existing LLM agents are typically designed for static systems and lack the ability to adapt over time in response to new challenges. This survey is the first to systematically summarize the potential techniques for incorporating lifelong learning into LLM-based agents. We categorize the core components of these agents into three modules: the perception module for multimodal input integration, the memory module for storing and retrieving evolving knowledge, and the action module for grounded interactions with the dynamic environment. We highlight how these pillars collectively enable continuous adaptation, mitigate catastrophic forgetting, and improve long-term performance. This survey provides a roadmap for researchers and practitioners working to develop lifelong learning capabilities in LLM agents, offering insights into emerging trends, evaluation metrics, and application scenarios. Relevant literature and resources are available at \href{this url}{https://github.com/qianlima-lab/awesome-lifelong-llm-agent}.

持续学习大模型智能体AGI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。