用深度引导提升图像修复,解决模糊与背景过增强问题
Similarity Matters: A Novel Depth-guided Network for Image Restoration and A New Dataset
- 双分支结构:深度估计+图像修复协同优化
- 9205张高分辨率植物图像,覆盖多样深度与纹理
- 自适应相似性建模,适合复杂景深场景的修复
近年来图像修复取得显著进展,但现有方法常忽略深度信息,导致浅景深下相似性匹配失效、注意力分散,深景深时背景过度增强。为此,我们提出一种新型深度引导网络(DGN)及大规模高分辨率数据集。网络包含两个交互分支:深度估计分支提供结构引导,图像修复分支执行核心任务。修复分支通过渐进窗口自注意力捕捉对象内相似性,利用稀疏非局部注意力建模对象间相似性。联合训练中,深度特征提升修复质量,修复特征反向优化深度估计。我们引入新数据集,包含403种植物的9,205张高分辨率图像,涵盖多样的深度与纹理变化。大量实验表明,该方法在多个标准基准上达到领先性能,并对未见植物图像具有良好泛化能力,验证了其有效性与鲁棒性。
原文摘要 · Abstract (English)
Image restoration has seen substantial progress in recent years. However, existing methods often neglect depth information, which hurts similarity matching, results in attention distractions in shallow depth-of-field (DoF) scenarios, and excessive enhancement of background content in deep DoF settings. To overcome these limitations, we propose a novel Depth-Guided Network (DGN) for image restoration, together with a novel large-scale high-resolution dataset. Specifically, the network consists of two interactive branches: a depth estimation branch that provides structural guidance, and an image restoration branch that performs the core restoration task. In addition, the image restoration branch exploits intra-object similarity through progressive window-based self-attention and captures inter-object similarity via sparse non-local attention. Through joint training, depth features contribute to improved restoration quality, while the enhanced visual features from the restoration branch in turn help refine depth estimation. Notably, we also introduce a new dataset for training and evaluation, consisting of 9,205 high-resolution images from 403 plant species, with diverse depth and texture variations. Extensive experiments show that our method achieves state-of-the-art performance on several standard benchmarks and generalizes well to unseen plant images, demonstrating its effectiveness and robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。