arXiv:2501.04897cs.LG2025-01综述被引 12

首份在线持续学习综述,系统梳理81种方法与500多个组件。

Online Continual Learning: A Systematic Literature Review of Approaches, Challenges, and Benchmarks

  • 首次对81种在线持续学习方法进行系统分析
  • 提炼出超500个模型组件和83个数据集特征
  • 适合研究持续学习、智能系统部署的学者与工程师

在线持续学习(OCL)是机器学习中的关键领域,旨在使模型能实时适应不断变化的数据流,同时应对灾难性遗忘和稳定-可塑性权衡等挑战。本研究开展首个针对OCL的系统文献综述(SLR),分析了81种方法,提取超过1,000项任务特征,并识别出500多个组件(包括算法与工具)。我们还综述了涵盖图像分类、目标检测及多模态视觉-语言任务等应用的83个数据集。研究揭示了降低计算开销、开发领域无关解决方案、提升资源受限环境下的可扩展性等核心挑战。未来方向包括利用自监督学习处理多模态与序列数据,设计融合稀疏检索与生成回放的自适应记忆机制,以及构建适用于噪声或动态任务边界场景的高效框架。完整的方法流程与提取数据已公开于https://github.com/kiyan-rezaee/Systematic-Literature-Review-on-Online-Continual-Learning。

原文摘要 · Abstract (English)

Online Continual Learning (OCL) is a critical area in machine learning, focusing on enabling models to adapt to evolving data streams in real-time while addressing challenges such as catastrophic forgetting and the stability-plasticity trade-off. This study conducts the first comprehensive Systematic Literature Review (SLR) on OCL, analyzing 81 approaches, extracting over 1,000 features (specific tasks addressed by these approaches), and identifying more than 500 components (sub-models within approaches, including algorithms and tools). We also review 83 datasets spanning applications like image classification, object detection, and multimodal vision-language tasks. Our findings highlight key challenges, including reducing computational overhead, developing domain-agnostic solutions, and improving scalability in resource-constrained environments. Furthermore, we identify promising directions for future research, such as leveraging self-supervised learning for multimodal and sequential data, designing adaptive memory mechanisms that integrate sparse retrieval and generative replay, and creating efficient frameworks for real-world applications with noisy or evolving task boundaries. By providing a rigorous and structured synthesis of the current state of OCL, this review offers a valuable resource for advancing this field and addressing its critical challenges and opportunities. The complete SLR methodology steps and extracted data are publicly available through the provided link: https://github.com/kiyan-rezaee/ Systematic-Literature-Review-on-Online-Continual-Learning

持续学习系统综述在线学习模型演化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。