arXiv:2511.08322cs.CVcs.LG2025-11AAAI被引 1

新旧类别学习冲突导致模型误判,该方法通过保距训练减少错误翻转。

Mitigating Negative Flips via Margin Preserving Training

  • 在旧类与新类间引入显式边界校准项,保持原有分类边界稳定。
  • 实验显示负向翻转率显著降低,整体准确率仍保持高位。
  • 适合需要持续学习、避免旧任务性能下降的场景。

在图像分类中,随着训练类别数量增加,新旧类别间的分类边界会缩小,导致更新后的模型对原先正确分类的样本产生误判,即负向翻转现象。本文提出一种保距训练方法,在学习新类别时维持原模型的分类边界,通过在输出层对数上引入显式的边界校准项,增强旧类与新类之间的相对间隔。同时为避免过度约束新类导致准确率下降,采用双源焦点蒸馏损失,融合原模型和独立训练的新模型的决策信息,自适应地学习合理分类边界。在多个图像分类基准数据集上的大量实验表明,该方法能持续降低负向翻转率,同时保持高整体准确率。

原文摘要 · Abstract (English)

Minimizing inconsistencies across successive versions of an AI system is as crucial as reducing the overall error. In image classification, such inconsistencies manifest as negative flips, where an updated model misclassifies test samples that were previously classified correctly. This issue becomes increasingly pronounced as the number of training classes grows over time, since adding new categories reduces the margin of each class and may introduce conflicting patterns that undermine their learning process, thereby degrading performance on the original subset. To mitigate negative flips, we propose a novel approach that preserves the margins of the original model while learning an improved one. Our method encourages a larger relative margin between the previously learned and newly introduced classes by introducing an explicit margin-calibration term on the logits. However, overly constraining the logit margin for the new classes can significantly degrade their accuracy compared to a new independently trained model. To address this, we integrate a double-source focal distillation loss with the previous model and a new independently trained model, learning an appropriate decision margin from both old and new data, even under a logit margin calibration. Extensive experiments on image classification benchmarks demonstrate that our approach consistently reduces the negative flip rate with high overall accuracy.

持续学习分类边界负向翻转

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。