提出动态平衡稳定与适应性的新框架,提升持续学习效果。
Pareto Continual Learning: Preference-Conditioned Learning and Adaption for Dynamic Stability-Plasticity Trade-off
- 将稳定与适应性建模为多目标优化问题,生成多种权衡解。
- 在多个数据集上超越现有方法,实现更优的持续学习性能。
- 适合需要灵活应对不同任务场景的研究者与应用开发。
持续学习旨在顺序学习多个任务。其核心挑战在于平衡两个目标:保留旧任务知识(稳定性)和适应新任务(可塑性)。经验回放方法通过存储并重播历史数据来缓解灾难性遗忘,但忽略了稳定性-可塑性权衡的动态特性,寻求固定不变的平衡,导致训练和推理阶段适应性不足。本文提出帕累托持续学习(ParetoCL),将稳定性-可塑性权衡重新建模为多目标优化(MOO)问题。ParetoCL引入偏好条件模型,高效学习一组表示不同权衡的帕累托最优解,并在推理时实现动态适应。从泛化角度看,ParetoCL可视为一种目标增强方法,学习稳定性与可塑性不同组合下的表现。在多个数据集和设置上的大量实验表明,ParetoCL优于当前最先进的方法,并能适应多样化的持续学习场景。
原文摘要 · Abstract (English)
Continual learning aims to learn multiple tasks sequentially. A key challenge in continual learning is balancing between two objectives: retaining knowledge from old tasks (stability) and adapting to new tasks (plasticity). Experience replay methods, which store and replay past data alongside new data, have become a widely adopted approach to mitigate catastrophic forgetting. However, these methods neglect the dynamic nature of the stability-plasticity trade-off and aim to find a fixed and unchanging balance, resulting in suboptimal adaptation during training and inference. In this paper, we propose Pareto Continual Learning (ParetoCL), a novel framework that reformulates the stability-plasticity trade-off in continual learning as a multi-objective optimization (MOO) problem. ParetoCL introduces a preference-conditioned model to efficiently learn a set of Pareto optimal solutions representing different trade-offs and enables dynamic adaptation during inference. From a generalization perspective, ParetoCL can be seen as an objective augmentation approach that learns from different objective combinations of stability and plasticity. Extensive experiments across multiple datasets and settings demonstrate that ParetoCL outperforms state-of-the-art methods and adapts to diverse continual learning scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。