arXiv:2505.09952cs.LGcs.AI2025-05被引 4

提出仿人记忆的长期持续学习框架,缓解长期任务下的灾难性遗忘。

Task-Core Memory Management and Consolidation for Long-term Continual Learning

  • 设计任务核心记忆管理策略,动态索引关键知识。
  • 通过选择性保留难样本提升长期记忆稳定性,性能领先7.4%和6.5%。
  • 适合研究长期持续学习与记忆机制的学者参考。

本文聚焦长期持续学习(Long-CL)任务,模型需在长时间内顺序学习大量任务,同时保持已有知识,类比人类学习过程。传统持续学习设置中任务数量有限,而长期持续学习面临更严重的灾难性遗忘问题。本文回答两个核心问题:现有方法在长期场景下的表现如何?如何缓解长期序列更新带来的遗忘?为此,我们提出受人类记忆机制启发的新框架:引入任务核心记忆管理策略,高效索引并自适应更新关键记忆;构建长期记忆巩固机制,选择性保留困难且具有区分性的样本,增强知识留存。为推动该领域研究,我们构建并发布两个多模态与文本基准数据集——MMLongCL-Bench 和 TextLongCL-Bench。实验表明,Long-CL 在两项基准上分别优于前序最优方法 7.4% 和 6.5% AP,验证了该方法的有效性。

原文摘要 · Abstract (English)

In this paper, we focus on a long-term continual learning (CL) task, where a model learns sequentially from a stream of vast tasks over time, acquiring new knowledge while retaining previously learned information in a manner akin to human learning. Unlike traditional CL settings, long-term CL involves handling a significantly larger number of tasks, which exacerbates the issue of catastrophic forgetting. Our work seeks to address two critical questions: 1) How do existing CL methods perform in the context of long-term CL? and 2) How can we mitigate the catastrophic forgetting that arises from prolonged sequential updates? To tackle these challenges, we propose a novel framework inspired by human memory mechanisms for long-term continual learning (Long-CL). Specifically, we introduce a task-core memory management strategy to efficiently index crucial memories and adaptively update them as learning progresses. Additionally, we develop a long-term memory consolidation mechanism that selectively retains hard and discriminative samples, ensuring robust knowledge retention. To facilitate research in this area, we construct and release two multi-modal and textual benchmarks, MMLongCL-Bench and TextLongCL-Bench, providing a valuable resource for evaluating long-term CL approaches. Experimental results show that Long-CL outperforms the previous state-of-the-art by 7.4\% and 6.5\% AP on the two benchmarks, respectively, demonstrating the effectiveness of our approach.

持续学习记忆机制长序列知识保留

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。