用大脑机制实现少量标注下的持续学习,避免遗忘旧知识。
Contrastive Consolidation of Top-Down Modulations Achieves Sparsely Supervised Continual Learning
- 通过自上而下的调制与对比学习融合,实现无监督持续更新。
- 仅用1%标签即超越当前最优无监督与有监督方法。
- 适合需要长期学习且标注稀缺的AI系统设计者。
生物大脑能从无标签数据流中持续学习,并整合稀疏标注信息而不损失泛化能力。而现有机器学习方法在持续学习中易产生灾难性遗忘,尤其在使用监督微调时会损害原始任务性能。本文提出任务调制对比学习(TMCL),受新皮层生物物理机制启发,基于预测编码原理,持续无监督地融合自上而下的信息。该方法利用对比损失构建视角不变表示空间;当出现新类别的标注样本时,学习新的仿射调制以增强新类与其他类的分离,且不改变前馈权重。通过复用历史调制,使表示空间具备调制不变性并稳定化。实验表明,在类别增量与迁移学习任务中,仅使用1%标注即可超越当前最优无监督及可比监督方法。结果表明,自上而下调制在平衡稳定性与可塑性中起关键作用。
原文摘要 · Abstract (English)
Biological brains learn continually from a stream of unlabeled data, while integrating specialized information from sparsely labeled examples without compromising their ability to generalize. Meanwhile, machine learning methods are susceptible to catastrophic forgetting in this natural learning setting, as supervised specialist fine-tuning degrades performance on the original task. We introduce task-modulated contrastive learning (TMCL), which takes inspiration from the biophysical machinery in the neocortex, using predictive coding principles to integrate top-down information continually and without supervision. We follow the idea that these principles build a view-invariant representation space, and that this can be implemented using a contrastive loss. Then, whenever labeled samples of a new class occur, new affine modulations are learned that improve separation of the new class from all others, without affecting feedforward weights. By co-opting the view-invariance learning mechanism, we then train feedforward weights to match the unmodulated representation of a data sample to its modulated counterparts. This introduces modulation invariance into the representation space, and, by also using past modulations, stabilizes it. Our experiments show improvements in both class-incremental and transfer learning over state-of-the-art unsupervised approaches, as well as over comparable supervised approaches, using as few as 1% of available labels. Taken together, our work suggests that top-down modulations play a crucial role in balancing stability and plasticity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。