持续学习正从参数更新转向系统级适应,涵盖时机、方式与位置的全面变革。
Continual Learning in Transition

- 提出三维度框架:何时、何法、何处学习
- 涵盖在线策略、推理时训练等新机制
- 适合关注AI系统演进的科研人员
传统持续学习聚焦于通过参数中心机制(如训练策略、架构设计、权重调整)实现模型更新与知识保留。然而新兴范式正将持续学习扩展至更广范围:例如,在策略学习拓宽了更新机制空间;推理时训练将学习延伸至推理阶段;外部组件如记忆库、技能库和交互协议则使模型能力突破静态参数限制。这些进展表明持续学习正从参数为中心转向系统级适应。为此,本文从三个维度审视持续学习演化:学习发生的时机(何时)、更新机制(如何)、以及作用位置(何处)。其中,'如何'涵盖离策略、在策略及梯度之外的优化机制;'何时'覆盖预训练、后训练与推理时阶段;'何处'区分内部参数更新与外部结构约束。基于此三轴框架,系统梳理代表性方法,追踪持续学习的演变趋势,并探讨由此带来的关键挑战、广泛影响与未来方向。
原文摘要 · Abstract (English)
Classical continual learning (CL) has primarily focused on enabling models to update and retain knowledge through parameter-centric mechanisms, e.g., training strategies, architectural designs, and weight adaptation. However, emerging paradigms are reshaping the scope of CL beyond this traditional model adaptation view. For instance, on-policy learning broadens the space of update mechanisms; test-time training extends CL from the training phase to inference; and external harness components such as memory, skill libraries, and interaction protocols extend the evolutionary boundaries of model capabilities far beyond the static parameter space. Collectively, these developments indicate a transition from parameter-centric learning toward system-level adaptation. To characterize this transition, we examine the evolution of continual learning through three dimensions: When, How, and Where learning occurs. The How dimension encompasses off-policy, on-policy, and beyond-gradient optimization mechanics. The When dimension captures evolution across pre-training, post-training, and inference-time stages. The Where dimension delineates updates occurring within internal parameters versus external structural constraints. Anchored by this tri-axial framework, we systematically survey representative methods, trace the ongoing transition of continual learning, and discuss the key challenges, broader implications, and future directions arising from this paradigm shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。