arXiv:2602.13670cs.LG2026-02中稿 · ICML

用视觉语言校准提升预训练模型的增量学习效果

Advancing Analytic Class-Incremental Learning through Vision-Language Calibration

  • 双分支结构通过特征与语义两级校准实现高效更新
  • 在8个基准上表现优于现有方法,细粒度任务更优
  • 适合需要快速适应新类别且保持稳定性的场景

基于预训练模型(PTM)的类增量学习(CIL)面临高效适应与长期稳定性的矛盾。虽然解析学习能实现快速、递归的闭式更新,但其效果常受累积误差和特征不兼容影响。本文系统分析了PTM驱动的解析CIL失败模式,发现表征僵化是主要瓶颈。为此提出VILA框架,采用两级视觉-语言校准策略:在特征层面通过几何校准融合可塑的任务适配特征与冻结的通用视觉锚点;在决策层面利用跨模态语义先验纠正预测偏差。该设计在保持解析学习极高效率的同时,克服了其固有脆弱性。在八个基准上的实验表明,VILA性能持续领先,尤其在细粒度和长序列场景中优势明显。该框架实现了高保真预测与解析学习简洁性的统一。代码已开源:https://github.com/byzhaoAI/VILA。

原文摘要 · Abstract (English)

Class-incremental learning (CIL) with pre-trained models (PTMs) faces a critical trade-off between efficient adaptation and long-term stability. While analytic learning enables rapid, recursive closed-form updates, its efficacy is often compromised by accumulated errors and feature incompatibility. In this paper, we first conduct a systematic study to dissect the failure modes of PTM-based analytic CIL, identifying representation rigidity as the primary bottleneck. Motivated by this insight, we propose VILA, a novel dual-branch framework that advances analytic CIL via a two-level vision-language calibration strategy. Specifically, we coherently fuse plastic, task-adapted features with a frozen, universal visual anchor at the feature level through geometric calibration, and leverage cross-modal semantic priors at the decision level to rectify prediction bias. This confluence maintains analytic-learning's extreme efficiency while overcoming its inherent brittleness. Extensive experiments across eight benchmarks demonstrate that VILA consistently yields superior performance, particularly in fine-grained and long-sequence scenarios. Our framework harmonizes high-fidelity prediction with the simplicity of analytic learning. Our code is available at https://github.com/byzhaoAI/VILA.

增量学习视觉语言预训练模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。