arXiv:2512.00940cs.LG2025-12NeurIPS被引 2

用类脑记忆模块实现多任务快速切换与长期记忆保留

Memory-Integrated Reconfigurable Adapters: A Unified Framework for Settings with Multiple Tasks

  • 在共享主干上集成霍普菲尔德记忆模块,按样本动态检索适配器更新
  • 在域泛化任务中达到最新最高外分布准确率,在持续学习中优于专门设计模型
  • 融合生物启发记忆机制,适合需要快速适应多场景的AI系统

生物体能在毫秒级完成逃避捕食者、觅食、穿越复杂地形和社交等任务,并在不产生灾难性遗忘的情况下保留已学环境知识。神经科学家认为这得益于单一神经回路被多巴胺等神经调制剂动态调控。深度学习中,领域泛化(DG)与持续学习(CL)面临类似挑战,但现有方法仍孤立发展,未利用生物系统中的关联记忆(AMs)。本文提出内存集成可重构适配器(MIRA),在共享主干上叠加霍普菲尔德风格的关联记忆模块。通过后训练学习记忆键,可按样本索引并检索存储的适配器更新组合。仅改变任务目标即可统一处理域漂移与顺序任务暴露。标准基准测试表明,该架构显著提升适应性与记忆保持:在域泛化中达到最先进外分布准确率;在增量学习中超越专为抗遗忘设计的模型。通过将适配器调制与生物启发记忆结合,MIRA 实现了快速任务切换与持久知识保留,为更通用、记忆增强型AI系统提供可行路径。

原文摘要 · Abstract (English)

Organisms constantly pivot between tasks such as evading predators, foraging, traversing rugged terrain, and socializing, often within milliseconds. Remarkably, they preserve knowledge of once-learned environments sans catastrophic forgetting, a phenomenon neuroscientists hypothesize, is due to a singular neural circuitry dynamically overlayed by neuromodulatory agents such as dopamine and acetylcholine. In parallel, deep learning research addresses analogous challenges via domain generalization (DG) and continual learning (CL), yet these methods remain siloed, despite the brains ability to perform them seamlessly. In particular, prior work has not explored architectures involving associative memories (AMs), which are an integral part of biological systems, to jointly address these tasks. We propose Memory-Integrated Reconfigurable Adapters (MIRA), a unified framework that integrates Hopfield-style associative memory modules atop a shared backbone. Associative memory keys are learned post-hoc to index and retrieve an affine combination of stored adapter updates for any given task or domain on a per-sample basis. By varying only the task-specific objectives, we demonstrate that MIRA seamlessly accommodates domain shifts and sequential task exposures under one roof. Empirical evaluations on standard benchmarks confirm that our AM-augmented architecture significantly enhances adaptability and retention: in DG, MIRA achieves SoTA out-of-distribution accuracy, and in incremental learning settings, it outperforms architectures explicitly designed to handle catastrophic forgetting using generic CL algorithms. By unifying adapter-based modulation with biologically inspired associative memory, MIRA delivers rapid task switching and enduring knowledge retention in a single extensible architecture, charting a path toward more versatile and memory-augmented AI systems.

持续学习关联记忆适配器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。