arXiv:2606.29465cs.LG2026-06

用隐状态分布代替图像存储,实现无需记忆旧样本的持续学习。

Prototype Latent World Model Replay for Class-Incremental Learning

论文配图:Prototype Latent World Model Replay for Class-Incremental Learning
图 1 · 摘自论文原文
  • 将旧类别抽象为稳定隐状态的原型分布,替代原始图像存储。
  • 在Inc5/10/20设置下,准确率提升至43.10%/52.19%/56.18%,超越微调方法。
  • 适合资源受限场景下的长期模型更新,尤其关注旧知识保留。

类别增量学习要求模型在不丢失旧类别判别区域的前提下学习新类别,但当原始旧样本无法获取时尤为困难。本文提出原型隐状态世界模型回放(Prototype Latent World Model Replay),一种无需存储记忆的框架:使用冻结的ImageNet预训练编码器将图像映射至隐状态空间,每个类别由若干类特定方差的原型中心分布表示。当新类别到来时,模型从该原型世界模型中采样旧隐状态,并结合真实新类别特征,通过轻量级适配器和分类器进行训练。同时,在适配器空间加入监督对比项,增强类内紧凑性与新旧类分离。在Split CIFAR-100上,该方法在Inc5、Inc10、Inc20设置下分别将最终准确率(LastAcc)从4.55%、9.06%、16.96%提升至31.64%、37.06%、43.10%,平均准确率(AvgAcc)达45.86%、52.19%、56.18%。消融与保留分析表明,稳定隐状态回放是性能提升主因,对比分离进一步优化新旧类几何结构。结果表明,原型隐状态记忆可保留可复用的类状态分布,而不仅是当前分类器的拟合。

原文摘要 · Abstract (English)

Class-incremental learning requires a model to learn new classes while preserving decision regions for old ones. This is difficult when raw old samples are no longer available. We propose Prototype Latent World Model Replay, a memory-free framework that stores old classes as distributions over stable hidden states rather than as images. A frozen ImageNet-pretrained encoder maps each image into a latent state space. In this space, each class is summarized by several prototype-centered distributions with class-specific variances. When new classes arrive, the model samples old latent states from this prototype world model. It then trains a lightweight adapter and classifier using both sampled old states and real new-class features. We also add a supervised contrastive term in the adapter space to promote intra-class compactness and old-new class separation. On Split CIFAR-100, our method improves over fine-tuning under Inc5, Inc10, and Inc20 without storing raw exemplars. The full Ours-LWM+Con model raises LastAcc from 4.55% to 31.64%, from 9.06% to 37.06%, and from 16.96% to 43.10% in Inc5, Inc10, and Inc20, respectively. It also achieves AvgAcc of 45.86%, 52.19%, and 56.18%. Ablation and retention analyses show that stable latent-state replay is the main source of the gain. Contrastive separation further refines the old-new geometry. These results suggest that prototype latent memory preserves reusable class-state distributions, rather than only fitting the current classifier.

增量学习隐状态建模无记忆学习对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。