arXiv:2505.12191cs.CVcs.AI2025-05NeurIPS被引 4

无需去噪器,通过数据课程训练实现噪声鲁棒的自监督学习

Ditch the Denoiser: Emergence of Noise Robustness in Self-Supervised Learning from Data Curriculum

  • 先用噪声数据训练去噪器,再构建去噪-噪声渐进式数据课程
  • 在极端高斯噪声下线性探测准确率提升4.8%(σ=255)
  • 适合医疗影像、天文等含噪真实场景的模型预训练

自监督学习(SSL)能从无标签数据中提取丰富表征,但现有研究多聚焦于干净高质量数据。实际应用如天体物理、医学影像、地质学和金融等领域常面临噪声数据挑战。本文提出一种完全自监督的框架,在无需推理或微调时使用去噪器的前提下,实现噪声鲁棒表征学习。方法首先在噪声数据上训练一个SSL去噪器,再利用其构建去噪到噪声的数据课程(先训练去噪样本,再训练噪声样本),用于预训练主干网络(如DINOv2),并引入教师引导正则化,将噪声嵌入锚定至对应去噪嵌入。该过程促使模型内化噪声鲁棒性。值得注意的是,预训练完成后可丢弃去噪器,简化部署。在ImageNet-1k上,使用ViT-B模型,在极端高斯噪声(σ=255,信噪比0.72 dB)下,本方法相比DINOv2线性探测准确率提升4.8%,证明了去噪器自由的鲁棒性可通过噪声感知预训练实现。代码已公开于https://github.com/wenquanlu/noisy_dinov2。

原文摘要 · Abstract (English)

Self-Supervised Learning (SSL) has become a powerful solution to extract rich representations from unlabeled data. Yet, SSL research is mostly focused on clean, curated and high-quality datasets. As a result, applying SSL on noisy data remains a challenge, despite being crucial to applications such as astrophysics, medical imaging, geophysics or finance. In this work, we present a fully self-supervised framework that enables noise-robust representation learning without requiring a denoiser at inference or downstream fine-tuning. Our method first trains an SSL denoiser on noisy data, then uses it to construct a denoised-to-noisy data curriculum (i.e., training first on denoised, then noisy samples) for pretraining a SSL backbone (e.g., DINOv2), combined with a teacher-guided regularization that anchors noisy embeddings to their denoised counterparts. This process encourages the model to internalize noise robustness. Notably, the denoiser can be discarded after pretraining, simplifying deployment. On ImageNet-1k with ViT-B under extreme Gaussian noise ($σ=255$, SNR = 0.72 dB), our method improves linear probing accuracy by 4.8% over DINOv2, demonstrating that denoiser-free robustness can emerge from noise-aware pretraining. The code is available at https://github.com/wenquanlu/noisy_dinov2.

自监督学习噪声鲁棒数据课程DINOv2

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。