arXiv:2511.19466cs.CVcs.AI2025-11

提出在线稳定引导框架,实时高效估算图像数据影响度,提升噪声检测精度。

SG-OIF: A Stability-Guided Online Influence Framework for Reliable Vision Data

  • 利用算法稳定性实时控制,轻量级维护训练点影响估计
  • 在CIFAR-10(20%异构噪声)上顶1%样本准确率达91.1%,MNIST AUPR达99.8%
  • 适合需要实时数据质量监控的视觉模型部署场景

估算训练样本对测试预测的影响对于部署深度学习视觉模型至关重要,尤其用于识别噪声数据。尽管影响函数可用于分析单个训练样本微小权重调整或移除对模型输出的影响,但在深度视觉模型中其实现仍具挑战:逆曲率计算成本高,且训练非平稳性破坏静态近似。已有方法采用迭代求解器和低秩代理降低开销,但离线计算滞后于训练动态,缺乏置信度校准导致排名脆弱,难以准确识别关键样本。为此,我们提出首个将算法稳定性作为实时控制器的在线影响框架(SG-OIF),(i) 通过随机Richardson与预条件Neumann方法保持轻量锚定的IHVP;(ii) 设计模块化曲率后端,基于稳定性引导的残差阈值、异常门控和置信度调节每样本影响得分。实验表明,SG-OIF在多个数据集上的噪声标签和分布外检测任务中均达到最新水平,显著优于现有方法。特别地,在CIFAR-10(20%异构噪声)上,前1%预测样本的准确率达91.1%;在MNIST上,AUPR高达99.8%,充分证明该框架是在线影响估计的实用控制器。

原文摘要 · Abstract (English)

Approximating training-point influence on test predictions is critical for deploying deep-learning vision models, essential for locating noisy data. Though the influence function was proposed for attributing how infinitesimal up-weighting or removal of individual training examples affects model outputs, its implementation is still challenging in deep-learning vision models: inverse-curvature computations are expensive, and training non-stationarity invalidates static approximations. Prior works use iterative solvers and low-rank surrogates to reduce cost, but offline computation lags behind training dynamics, and missing confidence calibration yields fragile rankings that misidentify critical examples. To address these challenges, we introduce a Stability-Guided Online Influence Framework (SG-OIF), the first framework that treats algorithmic stability as a real-time controller, which (i) maintains lightweight anchor IHVPs via stochastic Richardson and preconditioned Neumann; (ii) proposes modular curvature backends to modulate per-example influence scores using stability-guided residual thresholds, anomaly gating, and confidence. Experimental results show that SG-OIF achieves SOTA (State-Of-The-Art) on noise-label and out-of-distribution detection tasks across multiple datasets with various corruption. Notably, our approach achieves 91.1\% accuracy in the top 1\% prediction samples on the CIFAR-10 (20\% asym), and gets 99.8\% AUPR score on MNIST, effectively demonstrating that this framework is a practical controller for online influence estimation.

视觉模型数据清洗在线学习影响估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。