用强化学习动态选择扩散方向,让去噪更自适应。
Reinforced Diffusion: Learning to Push the Limits of Anisotropic Diffusion for Image Denoising
- 用深度Q-learning控制每步扩散动作,实现自适应去噪
- 在三种常见噪声上优于传统扩散方法,媲美CNN模型
- 适合需要高精度去噪且关注结构保持的视觉任务
图像去噪是低层视觉中的关键问题,也是诸多图像恢复任务的核心模块。各向异性扩散是一类表现优异的去噪方法,但传统方法依赖固定扩散算子,难以适应复杂图像结构,性能受限于近年学习型方法。本文提出一种基于强化学习的可训练各向异性扩散框架:将去噪过程建模为一系列由深度Q-learning学习顺序的朴素扩散动作,所选动作组合成具备强结构适应性的随机各向异性扩散过程。该方法应用于去除三种常见噪声,在实验中显著优于现有基于扩散的方法,并达到代表性深度卷积网络方法的水平。
原文摘要 · Abstract (English)
Image denoising is an important problem in low-level vision and serves as a critical module for many image recovery tasks. Anisotropic diffusion is a wide family of image denoising approaches with promising performance. However, traditional anisotropic diffusion approaches use explicit diffusion operators which are not well adapted to complex image structures. As a result, their performance is limited compared to recent learning-based approaches. In this work, we describe a trainable anisotropic diffusion framework based on reinforcement learning. By modeling the denoising process as a series of naive diffusion actions with order learned by deep Q-learning, we propose an effective diffusion-based image denoiser. The diffusion actions selected by deep Q-learning at different iterations indeed composite a stochastic anisotropic diffusion process with strong adaptivity to different image structures, which enjoys improvement over the traditional ones. The proposed denoiser is applied to removing three types of often-seen noise. The experiments show that it outperforms existing diffusion-based methods and competes with the representative deep CNN-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。