arXiv:2506.00564eess.IVcs.CV2025-06被引 3

在傅里叶域用噪声目标训练图像修复,提升真实场景下的效果。

Image Restoration Learning via Noisy Supervision in the Fourier Domain

  • 在傅里叶域建立噪声监督,利用噪声系数的稀疏性与独立性。
  • 统一框架适配多种任务与网络,提升定量指标与视觉质量。
  • 适合低光、遥感等含空间相关噪声的图像修复场景。

噪声监督指使用带噪目标来指导图像修复学习,可减轻数据收集负担并增强深度学习的实际应用性。然而现有方法存在两大缺陷:一是难以处理低光成像和遥感中常见的空间相关噪声;二是依赖像素级损失函数,监督信息有限。本文提出在傅里叶域进行噪声监督。我们证明了各类噪声的傅里叶系数在分布上趋近高斯分布,由此建立带噪目标与干净目标在傅里叶域的等价性。该性质使傅里叶域具备全局信息,能提供更强监督。基于此,构建统一学习框架,适用于多种图像修复任务、网络结构及噪声模型。大量实验验证其在定量指标与感知质量上的优异表现。

原文摘要 · Abstract (English)

Noisy supervision refers to supervising image restoration learning with noisy targets. It can alleviate the data collection burden and enhance the practical applicability of deep learning techniques. However, existing methods suffer from two key drawbacks. Firstly, they are ineffective in handling spatially correlated noise commonly observed in practical applications such as low-light imaging and remote sensing. Secondly, they rely on pixel-wise loss functions that only provide limited supervision information. This work addresses these challenges by leveraging the Fourier domain. We highlight that the Fourier coefficients of spatially correlated noise exhibit sparsity and independence, making them easier to handle. Additionally, Fourier coefficients contain global information, enabling more significant supervision. Motivated by these insights, we propose to establish noisy supervision in the Fourier domain. We first prove that Fourier coefficients of a wide range of noise converge in distribution to the Gaussian distribution. Exploiting this statistical property, we establish the equivalence between using noisy targets and clean targets in the Fourier domain. This leads to a unified learning framework applicable to various image restoration tasks, diverse network architectures, and different noise models. Extensive experiments validate the outstanding performance of this framework in terms of both quantitative indices and perceptual quality.

图像修复傅里叶域噪声建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。