arXiv:2508.19830cs.CVcs.AI2025-08中稿 · ICML被引 1

无需目标域数据,通过频域滤波提升模型在分布偏移下的可靠性。

Target-Agnostic Calibration under Distribution Shift with Frequency-Aware Gradient Rectification

  • 利用频域低通滤波消除高频率虚假线索,学习域不变特征。
  • 在多种分布偏移下校准误差降低30%以上,且保持原始数据集性能。
  • 适用于安全关键场景,兼容事后校准方法,实用性强。

真实世界模型部署不可避免地遭遇分布偏移,导致深度神经网络的置信度估计极不可靠,给安全关键应用带来严重风险。现有方法通过训练阶段正则化或事后调整改善校准,但通常依赖目标域数据或其模拟,实用性受限。本文提出频域感知梯度修正(FGR),一种无需目标域信息的鲁棒校准训练框架。从频域视角出发,FGR对部分训练图像施加低通滤波,以削弱虚假高频率线索,促进域不变特征学习。然而,由此带来的信息损失可能损害分布内(ID)校准性能。为解决这一权衡,FGR将ID校准视为硬约束,通过几何投影修正冲突的参数更新,确保ID校准目标一阶不增加,且无需额外的损失平衡系数。在合成、真实世界及语义偏移数据集上的大量实验表明,FGR在多种分布偏移下显著提升校准性能,同时保持ID表现,并与事后校准方法兼容。代码已开源:https://github.com/YilinZhang107/FGR-Calib。

原文摘要 · Abstract (English)

Real-world model deployments inevitably encounter distribution shifts, rendering the confidence estimates of deep neural networks highly unreliable, posing severe risks in safety-critical applications. Existing methods improve calibration via training-time regularization or post-hoc adjustment, but often rely on access to (or simulation of) target domains, limiting practicality. We propose Frequency-aware Gradient Rectification (FGR), a target-agnostic training framework for robust calibration. From a frequency perspective, FGR applies low-pass filtering to a subset of training images to diminish spurious high-frequency cues and encourage the learning of domain-invariant features. However, the associated information loss can degrade In-Distribution (ID) calibration. To resolve this trade-off, FGR treats ID calibration as a hard constraint and rectifies conflicting parameter updates via geometric projection. This ensures a first-order non-increase in the ID calibration objective without introducing an additional loss-balancing coefficient. Extensive experiments on synthetic, real-world, and semantic shift datasets demonstrate that FGR significantly improves calibration under diverse shifts while preserving ID performance, and it remains compatible with post-hoc calibration methods. Our code is available at https://github.com/YilinZhang107/FGR-Calib.

分布偏移校准频域鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。