arXiv:2607.17593cs.CV2026-07中稿 · IEEE Transactions …

提出Miles方法,在预训练模型上高效增量学习新类别。

Miles: Metric Learning with Expandable Subspace for Pre-Trained Model-Based Class-Incremental Learning

论文配图:Miles: Metric Learning with Expandable Subspace for Pre-Trained Model-Based Class-Incremental Learning
图 1 · 摘自论文原文
  • 解耦可学习模块与预训练模型,利用中间特征引导参数扩展
  • 在六个数据集上达到当前最优性能,避免灾难性遗忘
  • 适合需要高效增量学习的工业场景或资源受限环境

类增量学习(CIL)旨在从数据流中持续学习新概念而不遗忘旧知识。与传统从零开始训练的方法不同,预训练模型(PTM)可通过微调快速适应新任务。然而,现有基于PTM的CIL方法难以平衡性能与计算开销:要么使用相同参数空间导致严重遗忘,要么为每项任务新增分支而增加计算负担。为此,本文提出度量学习可扩展子空间(Miles),利用预训练知识中的先验信息,通过有指导的优化实现高效参数空间扩展。具体而言,将可学习模块与预训练模型解耦,并利用骨干网络中间特征提供先验信息,实现更灵活的参数扩展;同时引入中心损失,引导新类别在新任务子空间中聚向对应原型,并加入辅助距离正则项以维持跨任务度量均衡。在六个基准数据集上的大量实验表明,Miles在多种CIL设置下均达到领先性能。

原文摘要 · Abstract (English)

Class Incremental Learning (CIL) aims to learn new concepts consistently from a data stream without forgetting. Unlike typical CIL methods which need to learn a model from scratch, pre-trained model (PTM) can easily adapt to a new task with fine-tuning. However, existing PTM-based CIL methods fail to achieve a trade-off between performance and computational expenditure, i.e., they either adopt the same parameter space so that leading catastrophic forgetting, or expand a new branch for each task but adding more computational cost. To this end, we propose MetrIc Learning with Expandable Subspace (Miles) to harness the prior information within pre-trained knowledge, thereby orchestrating an efficient expansion of the parameter space through guided optimization. Specifically, it decouples the learnable modules with the pre-trained model, exploiting prior information from intermediate features of the backbone network to enable more flexible parameter expansion. Then, a central loss is adopted to guide the new category to cluster towards the corresponding prototype in the new task subspace while incorporating an auxiliary distance regularization term to maintain metric equilibrium across tasks. Extensive experiments on six benchmark datasets demonstrate that Miles achieves state-of-the-art performance in various CIL settings.

增量学习度量学习预训练模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。