用可自适应的扩散模型修复图像噪声,让模型在测试时自动应对各种图像退化。
Discriminator-Guided Adaptive Diffusion for Source-Free Test-Time Adaptation under Image Corruptions

- 根据每张图像的退化程度动态调整去噪强度,由判别器决定何时停止扩散。
- 在15种不同图像退化类型上表现稳定,对非加性噪声的鲁棒性显著提升。
- 无需重新训练模型,适合部署在无法获取源数据的实时系统中。
本文研究了由图像退化引起的无源无监督域适应问题,这类退化包括模糊、天气效应和数字伪影等,远超于加性噪声。我们提出一种基于扩散模型的输入级测试时自适应框架,完全在测试阶段运行且保持所有源训练模型冻结,旨在提升对退化目标输入的鲁棒性。方法利用源训练的扩散模型作为生成先验,引入判别器引导的自适应扩散策略,动态控制每张测试样本的扰动程度。不同于固定扩散深度,判别器基于图像自身特性决定何时足够前向扩散以抑制特定退化特征,每种退化类型被视为一个独立的目标域。该自适应停止机制仅施加必要噪声以去除退化特征,同时保留类别判别结构。随后的反向扩散过程重建与源域对齐的图像,可选地通过结构引导进行稳定,再使用冻结的源训练分类器进行分类。我们在涵盖15种多样退化类型的广泛目标域上评估该方法,证明其在非噪声退化上具有更均衡的鲁棒性,性能达到或优于现有方法。额外分析揭示了自适应扩散调度对不同退化特征的响应,验证了该框架的实用性、通用性和鲁棒性。代码已公开于 https://github.com/fmolivato/dgadiffusion/。
原文摘要 · Abstract (English)
In this work, we study Source-Free Unsupervised Domain Adaptation under corruption-induced domain shifts, where performance degradation is caused by natural image corruptions that go beyond additive noise, including blur, weather effects, and digital artifacts. We propose a diffusion-based, input-level adaptation framework that operates entirely at test time and keeps all source-trained models frozen, explicitly targeting robustness to corrupted target inputs. Our method leverages a source-trained diffusion model as a generative prior and introduces a discriminator-guided adaptive diffusion strategy that dynamically controls the amount of perturbation applied to each test sample. Rather than relying on a fixed diffusion depth, the discriminator determines, on a per-image basis, when sufficient forward diffusion has been applied to suppress corruption-specific artifacts, with each corruption type effectively defining a distinct target domain. This adaptive stopping mechanism applies only the necessary amount of noise to remove domainspecific corruption while preserving class-discriminative structure. The reverse diffusion process then reconstructs a source-aligned image, optionally stabilized through structural guidance, which is classified using a frozen source-trained classifier. We evaluate the proposed approach across a broad spectrum of corruption-induced target domains, covering 15 diverse corruption types, and demonstrate more balanced robustness with competitive or improved performance across non-noise corruptions. Additional analyses reveal how the adaptive diffusion schedule responds to different corruption characteristics, highlighting the practicality, generality, and robustness of the proposed framework. The code is publicly available at https://github.com/fmolivato/dgadiffusion/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。