用局部不确定性动态调整采样,让扩散模型修复图像更快更准。
Local Epistemic Uncertainty Guided Active Sampling for Plug-and-play Diffusive Image Restoration

- 根据像素不确定性自适应调节先验强度,平衡细节与伪影。
- 通过轨迹剪枝将采样时间减少40%以上,误差有理论保证。
- 插件式设计,可无缝接入多种图像修复模型,适合快速部署。
扩散模型在图像修复中表现优异,但现有方法通常依赖固定数据约束和均匀采样步数,忽视生成过程的动态特性。这种僵化设计使模型易受空间非均匀退化影响,导致结构失真和细节丢失;同时均匀采样引入计算冗余,而简单减步策略易积累近似误差。为此,本文提出局部认知不确定性引导的主动采样框架(LEADer)。在空间域,利用像素级不确定性动态调节零空间中的先验强度,有效平衡细节保留与伪影抑制;在时间域,通过不确定性迹量化采样稳定性,实现自适应轨迹剪枝,加速收敛。理论证明该框架严格满足数据一致性,且剪枝策略具有确定性误差上界,确保跳步采样下的稳定收敛。值得注意的是,本方法为即插即用设计,可无缝集成至多种DMIR基线。大量实验表明,LEADer显著提升多个前沿方法性能,同时大幅降低采样时间,内存开销几乎可忽略。代码已开源:https://github.com/JiaqiZhang-Sengoku/LEADer。
原文摘要 · Abstract (English)
Diffusion models have demonstrated remarkable effectiveness in image restoration tasks. However, when guiding image reconstruction, existing Diffusion Model-based Image Restoration (DMIR) methods typically rely on fixed data constraints and uniform step sizes, thereby overlooking the dynamic nature of the generative process. Such rigid designs render the models vulnerable to spatially non-uniform degradations, thus resulting in structural distortions and loss of fine details. Meanwhile, uniform step sizes introduce computational redundancy, whereas naïve step reduction strategies tend to accumulate approximation errors. To address these limitations, we propose a Local Epistemic Uncertainty Guided Active Sampling framework (LEADer). In the spatial domain, LEADer leverages pixel-wise uncertainty to dynamically modulate the prior strength within the null space, which effectively balances detail preservation and artifact suppression. In the temporal domain, it quantifies sampling stability via the uncertainty trace to enable adaptive trajectory pruning, thereby accelerating convergence. Theoretical proofs demonstrate that our framework achieves strict data consistency, while the trajectory pruning strategy admits a deterministic error bound, thereby guaranteeing stable convergence under skip sampling. Notably, our plug-and-play method can be seamlessly integrated into various DMIR baselines. Extensive experiments show that LEADer improves the performance of multiple state-of-the-art DMIR methods, while significantly reducing sampling time with negligible memory overhead. Code is available at https://github.com/JiaqiZhang-Sengoku/LEADer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。