arXiv:2504.14092cs.CV2025-04CVPR被引 7

无需阴影掩码,用光照引导的混合模型实现高效去阴影。

Retinex-guided Histogram Transformer for Mask-free Shadow Removal

  • 分路建模反射与光照,结合CNN和光照引导的直方图注意力块。
  • 仅在NTIRE 2025数据集训练,参数少、推理快,性能领先。
  • 适合计算资源受限的真实场景应用,代码已开源。

尽管深度学习在去阴影任务中取得显著进展,但多数方法依赖难以获取的阴影掩码,限制了其在真实场景中的泛化能力。本文提出ReHiT,一种基于Retinex理论指导的混合CNN-Transformer架构的无掩码去阴影框架。首先设计双分支结构,分别建模反射率与光照成分,并由所提出的光照引导混合CNN-Transformer(IG-HCT)模块进行恢复。其次,在具备残差密集特征学习与多尺度语义融合能力的CNN模块基础上,引入光照引导直方图变压器块(IGHB),有效处理非均匀光照与空间复杂阴影。在多个基准数据集上的实验验证了方法的有效性。仅在NTIRE 2025阴影去除挑战数据集上训练,本方案在同类方法中参数量最小、推理速度最快,且性能优异,展现出在计算资源受限的真实应用中的强适用性。代码已公开于https://github.com/dongw22/oath。

原文摘要 · Abstract (English)

While deep learning methods have achieved notable progress in shadow removal, many existing approaches rely on shadow masks that are difficult to obtain, limiting their generalization to real-world scenes. In this work, we propose ReHiT, an efficient mask-free shadow removal framework based on a hybrid CNN-Transformer architecture guided by Retinex theory. We first introduce a dual-branch pipeline to separately model reflectance and illumination components, and each is restored by our developed Illumination-Guided Hybrid CNN-Transformer (IG-HCT) module. Second, besides the CNN-based blocks that are capable of learning residual dense features and performing multi-scale semantic fusion, multi-scale semantic fusion, we develop the Illumination-Guided Histogram Transformer Block (IGHB) to effectively handle non-uniform illumination and spatially complex shadows. Extensive experiments on several benchmark datasets validate the effectiveness of our approach over existing mask-free methods. Trained solely on the NTIRE 2025 Shadow Removal Challenge dataset, our solution delivers competitive results with one of the smallest parameter sizes and fastest inference speeds among top-ranked entries, highlighting its applicability for real-world applications with limited computational resources. The code is available at https://github.com/dongw22/oath.

去阴影混合架构无掩码实时部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。