利用图像间一致性实现无需掩码的无监督去阴影
Consistency as Regularization for Unsupervised Shadow Removal

- 通过多张带阴影图像间的视觉一致性作为正则化信号
- 在多个基准上超越现有无监督方法,性能接近有监督模型
- 适合缺乏配对数据的图像修复与增强任务
去阴影是众多视觉任务的重要预处理步骤。现有监督方法需成对的带阴影与无阴影图像,而无监督方法通常仍依赖阴影掩码或无阴影参考图。本文提出ShadowCLR,一种直接从带阴影图像中学习去阴影的无监督框架。核心观察是:阴影随观测变化,但场景内容保持一致。因此,我们以跨观测的一致性作为正则化,促使模型恢复一致的场景外观,同时抑制阴影特异性变化。全局与局部一致性使模型能探索视觉相关的图像,从不完美对齐的观测中学习,并聚焦于共享场景信息。在多个基准上的实验表明,ShadowCLR在性能上达到甚至超过当前最先进的无监督方法,证明一致性可作为无需阴影掩码或无阴影图像的去阴影正则化手段。
原文摘要 · Abstract (English)
Shadow removal is an important preprocessing step for many vision tasks, yet existing supervised methods require paired shadow and shadow-free images, while unsupervised approaches often still rely on shadow masks or shadow-free references. We propose ShadowCLR, an unsupervised framework that learns shadow removal directly from shadow images. Our key observation is that shadows vary across observations while the underlying scene content remains largely consistent. We therefore use consistency across shadow observations as regularization, encouraging the model to recover scene-consistent appearance while suppressing shadow-specific variations. Global and local consistency further enable us to explore visually related images, learn from imperfectly aligned observations, and focus the representation on shared scene information. Experiments on multiple benchmarks show that ShadowCLR achieves competitive and often superior performance over state-of-the-art unsupervised methods, demonstrating that consistency can provide regularization for shadow removal without shadow masks or shadow-free images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。