arXiv:2603.05812cs.CVcs.AI2026-03

提升视觉模型校准性与鲁棒性,无需改架构或额外数据

Margin and Consistency Supervision for Calibrated and Robust Vision Models

  • 通过间隔惩罚和一致性正则联合约束分类输出间隔与局部稳定性
  • 在多个基准上实现更低的ECE、NLL,且对常见噪声扰动更鲁棒
  • 兼容各类模型架构,训练开销极低,可直接替换标准损失函数

深度视觉分类器常在高准确率下表现校准性差且对微小分布偏移敏感。本文提出一种简单、与架构无关的正则化框架MaCS,同时强化对数空间的类别间隔与局部预测稳定性。MaCS在交叉熵基础上增加两项:(i) 平方铰链损失项,强制正确类与最强竞争类之间保持目标对数间隔;(ii) 一致性正则项,最小化干净输入与轻微扰动视图间的预测KL散度。我们提供统一理论分析表明,增大分类间隔并降低局部敏感性(通过类似Lipschitz的稳定性代理)可提升泛化保证,并获得随间隔与敏感性比值增长的可证明鲁棒性半径。在多个图像分类基准及多种骨干网络(含CNN与ViT)上,MaCS持续改善校准性(更低的ECE与NLL),增强对常见噪声的鲁棒性,同时保持或提升顶1准确率。本方法无需额外数据、不改架构、推理开销可忽略,是标准训练目标的有效即插即用替代方案。

原文摘要 · Abstract (English)

Deep vision classifiers often achieve high accuracy while remaining poorly calibrated and fragile under small distribution shifts. We present Margin and Consistency Supervision (MaCS), a simple, architecture-agnostic regularization framework that jointly enforces logit-space separation and local prediction stability. MaCS augments cross-entropy with (i) a hinge-squared margin penalty that enforces a target logit gap between the correct class and the strongest competitor, and (ii) a consistency regularizer that minimizes the KL divergence between predictions on clean inputs and mildly perturbed views. We provide a unifying theoretical analysis showing that increasing classification margin while reducing local sensitivity formalized via a Lipschitz-type stability proxy yields improved generalization guarantees and a provable robustness radius bound scaling with the margin-to-sensitivity ratio. Across several image classification benchmarks and several backbones spanning CNNs and Vision Transformers, MaCS consistently improves calibration (lower ECE and NLL) and robustness to common corruptions while preserving or improving top-1 accuracy. Our approach requires no additional data, no architectural changes, and negligible inference overhead, making it an effective drop-in replacement for standard training objectives.

模型校准鲁棒性正则化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。