arXiv:2503.17347cs.CV2025-03AAAI被引 12

用扩散模型和多样数据实现任意图像的强鲁棒去反射

Dereflection Any Image with Diffusion Priors and Diversified Data

  • 构建新数据集DRR,通过旋转反射介质生成多样化反射场景
  • 提出一步扩散框架,实现快速确定性推理,精度优于现有方法
  • 三阶段渐进训练提升对真实复杂场景的泛化能力,适合实际应用

单张图像去反射仍因目标场景与反射的复杂耦合而极具挑战。现有方法受限于高质量、多样化数据稀缺及恢复先验不足,泛化能力有限。本文提出Dereflection Any Image,包含高效数据准备流程与可泛化模型。首先,构建名为DRR的数据集,通过随机旋转反射介质生成不同角度和强度的反射,显著提升规模、质量和多样性,树立新基准。其次,提出基于扩散的框架,采用一步扩散实现确定性输出与快速推理;为确保稳定训练,设计三阶段渐进策略,包括反射不变微调,以保持不同反射模式下的输出一致性。大量实验表明,该方法在通用基准与真实复杂图像上均达当前最优性能,跨真实场景泛化能力突出。

原文摘要 · Abstract (English)

Reflection removal of a single image remains a highly challenging task due to the complex entanglement between target scenes and unwanted reflections. Despite significant progress, existing methods are hindered by the scarcity of high-quality, diverse data and insufficient restoration priors, resulting in limited generalization across various real-world scenarios. In this paper, we propose Dereflection Any Image, a comprehensive solution with an efficient data preparation pipeline and a generalizable model for robust reflection removal. First, we introduce a dataset named Diverse Reflection Removal (DRR) created by randomly rotating reflective mediums in target scenes, enabling variation of reflection angles and intensities, and setting a new benchmark in scale, quality, and diversity. Second, we propose a diffusion-based framework with one-step diffusion for deterministic outputs and fast inference. To ensure stable learning, we design a three-stage progressive training strategy, including reflection-invariant finetuning to encourage consistent outputs across varying reflection patterns that characterize our dataset. Extensive experiments show that our method achieves SOTA performance on both common benchmarks and challenging in-the-wild images, showing superior generalization across diverse real-world scenes.

去反射扩散模型数据增强图像修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。