arXiv:2503.18055cs.CV2025-03CVPR被引 23

利用偏振信息去除图像反射,提升复杂场景清晰度

PolarFree: Polarization-based Reflection-free Imaging

  • 构建大规模偏振图像数据集PolaRGB,支持真实世界多场景训练
  • 提出PolarFree模型,通过扩散过程生成无反射图像特征
  • 在6500对图像上验证,显著改善强反射场景下的成像质量

反射去除因复杂的光相互作用而极具挑战,反射会遮蔽重要细节并阻碍场景理解。偏振天然提供了区分反射光与透射光的强大线索,有助于更准确地去除反射。然而现有方法多依赖小规模或合成数据集,难以捕捉真实场景的多样性与复杂性。为此,我们构建了大规模数据集PolaRGB,用于基于偏振的RGB图像反射去除,使模型能在广泛真实场景中有效泛化。PolaRGB包含6,500对高质量对齐的混合透射图像对,规模为现有偏振数据集的8倍,是首个涵盖多种室内外环境及不同光照条件下的RGB与偏振图像数据集。此外,为充分挖掘偏振线索在反射去除中的潜力,我们提出PolarFree,利用扩散过程生成无反射提示,实现高精度反射去除。大量实验表明,PolarFree显著提升了复杂反射场景下的图像清晰度,为偏振成像与反射去除设立了新基准。代码与数据集见https://github.com/mdyao/PolarFree。

原文摘要 · Abstract (English)

Reflection removal is challenging due to complex light interactions, where reflections obscure important details and hinder scene understanding. Polarization naturally provides a powerful cue to distinguish between reflected and transmitted light, enabling more accurate reflection removal. However, existing methods often rely on small-scale or synthetic datasets, which fail to capture the diversity and complexity of real-world scenarios. To this end, we construct a large-scale dataset, PolaRGB, for Polarization-based reflection removal of RGB images, which enables us to train models that generalize effectively across a wide range of real-world scenarios. The PolaRGB dataset contains 6,500 well-aligned mixed-transmission image pairs, 8x larger than existing polarization datasets, and is the first to include both RGB and polarization images captured across diverse indoor and outdoor environments with varying lighting conditions. Besides, to fully exploit the potential of polarization cues for reflection removal, we introduce PolarFree, which leverages diffusion process to generate reflection-free cues for accurate reflection removal. Extensive experiments show that PolarFree significantly enhances image clarity in challenging reflective scenarios, setting a new benchmark for polarized imaging and reflection removal. Code and dataset are available at https://github.com/mdyao/PolarFree.

偏振成像反射去除扩散模型图像修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。