arXiv:2605.06702cs.AIcs.CL2026-05

让大模型在部署中持续学习,通过记忆案例自我改进。

CASCADE: Case-Based Continual Adaptation for Large Language Models During Deployment

论文配图:CASCADE: Case-Based Continual Adaptation for Large Language Models During Deployment
图 1 · 摘自论文原文
  • 用案例记忆和上下文博弈机制实现无参数更新的持续学习
  • 在16个任务上比零样本提示提升20.9%的成功率
  • 适合需要长期迭代优化的智能体应用

大语言模型(LLMs)已成为现代人工智能的核心,但其生命周期仍受限于训练与部署阶段的严格分离,部署后学习基本停止。这与自然智能通过环境交互持续适应形成对比。本文将部署时学习(DTL)定义为LLM生命周期的第三阶段,使LLM代理在不修改参数的前提下,从部署经验中持续改进。我们提出CASCADE(CASe-based Continual Adaptation during DEployment),一种通用且原则性的框架,赋予LLM代理显式、可演化的情景记忆。CASCADE将经验重用建模为上下文博弈问题,实现有原则的探索-利用权衡,并在长期交互中建立无后悔保证。该设计使代理能够积累、选择并优化任务相关的案例,将过往经验转化为可操作知识。在涵盖医学诊断、法律分析、代码生成、网络搜索、工具使用及具身交互等16个不同任务中,CASCADE相比零样本提示提升了20.9%的宏平均成功率,且持续优于基于梯度和基于记忆的基线方法。本工作重新定义部署为自适应学习过程,为持续进化的AI系统奠定了基础。

原文摘要 · Abstract (English)

Large language models (LLMs) have become a central foundation of modern artificial intelligence, yet their lifecycle remains constrained by a rigid separation between training and deployment, after which learning effectively ceases. This limitation contrasts with natural intelligence, which continually adapts through interaction with its environment. In this paper, we formalise deployment-time learning (DTL) as the third stage in the LLM lifecycle that enables LLM agents to improve from experience during deployment without modifying model parameters. We present CASCADE (CASe-based Continual Adaptation during DEployment), a general and principled framework that equips LLM agents with an explicit, evolving episodic memory. CASCADE formulates experience reuse as a contextual bandit problem, enabling principled exploration-exploitation trade-offs and establishing no-regret guarantees over long-term interactions. This design allows agents to accumulate, select, and refine task-relevant cases, transforming past experience into actionable knowledge. Across 16 diverse tasks spanning medical diagnosis, legal analysis, code generation, web search, tool use, and embodied interaction, CASCADE improves macro-averaged success rate by 20.9% over zero-shot prompting while consistently outperforming gradient-based and memory-based baselines. By reframing deployment as an adaptive learning process, this work establishes a foundation for continually improving AI systems.

持续学习大模型智能体案例记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。