在频域重构图像,自动分离有用信号与噪声。
Deep Spectral Prior
- 在复数频域联合优化幅度和相位,捕捉完整频谱结构。
- 实验显示其去噪、修复等任务性能优于DIP等基线方法。
- 无需人工停止或先验,可自动生成物理合理的重建结果。
我们提出深度谱先验(DSP),一种完全在复数频域运行的无监督图像重建新框架。与依赖像素级误差且易过拟合的深度图像先验(DIP)不同,DSP联合学习幅度和相位,以捕获图像完整的频谱结构。我们推导了DSP优化动态的严格理论表征,证明其遵循频率相关的下降轨迹,能将信息丰富的低频成分与随机高频噪声分离。这种频谱模式分离解释了DSP的自正则化行为,并首次正式确立了消除DIP主要缺陷——依赖人工早停。此外,DSP隐式投影到频谱一致流形上,确保在无显式先验或监督的情况下收敛至稳定且物理合理的重建结果。在去噪、补全和去模糊任务上的大量实验表明,DSP持续优于DIP及其他无监督基线,在统一的无数据无监督框架下实现了更高的保真度、鲁棒性和理论可解释性。
原文摘要 · Abstract (English)
We introduce the Deep Spectral Prior (DSP), a new framework for unsupervised image reconstruction that operates entirely in the complex frequency domain. Unlike the Deep Image Prior (DIP), which optimises pixel-level errors and is highly sensitive to overfitting, DSP performs joint learning of amplitude and phase to capture the full spectral structure of images. We derive a rigorous theoretical characterisation of DSP's optimisation dynamics, proving that it follows frequency-dependent descent trajectories that separate informative low-frequency modes from stochastic high-frequency noise. This spectral mode separation explains DSP's self-regularising behaviour and, for the first time, formally establishes the elimination of DIP's major limitation-its reliance on manual early stopping. Moreover, DSP induces an implicit projection onto a frequency-consistent manifold, ensuring convergence to stable, physically plausible reconstructions without explicit priors or supervision. Extensive experiments on denoising, inpainting, and deblurring demonstrate that DSP consistently surpasses DIP and other unsupervised baselines, achieving superior fidelity, robustness, and theoretical interpretability within a unified, unsupervised data-free framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。