分离夜间光照退化,让夜景变白天更真实
Night-to-Day Translation via Illumination Degradation Disentanglement
- 基于物理模型分离不同光照退化区域
- 在两个数据集上显著提升图像质量
- 适合夜视增强与自动驾驶场景
夜间到白天的图像转换(Night2Day)旨在实现夜间场景的白天视觉效果。然而,在无配对条件下处理含有复杂退化的夜间图像仍是重大挑战。以往方法统一缓解退化,难以同时恢复白天域信息并保留语义。本文提出N2D3(Night-to-Day via Degradation Disentanglement),通过退化解耦模块和退化感知对比学习策略识别夜间图像中的不同退化模式。首先,利用基于Kubelka-Munk理论的光度模型提取物理先验;其次,基于这些先验设计解耦模块以区分不同光照退化区域;最后引入退化感知对比学习策略,保持不同退化区域间的语义一致性。在两个公开数据集上的实验表明,该方法在视觉质量上显著提升,并为下游任务带来显著潜力。
原文摘要 · Abstract (English)
Night-to-Day translation (Night2Day) aims to achieve day-like vision for nighttime scenes. However, processing night images with complex degradations remains a significant challenge under unpaired conditions. Previous methods that uniformly mitigate these degradations have proven inadequate in simultaneously restoring daytime domain information and preserving underlying semantics. In this paper, we propose \textbf{N2D3} (\textbf{N}ight-to-\textbf{D}ay via \textbf{D}egradation \textbf{D}isentanglement) to identify different degradation patterns in nighttime images. Specifically, our method comprises a degradation disentanglement module and a degradation-aware contrastive learning module. Firstly, we extract physical priors from a photometric model based on Kubelka-Munk theory. Then, guided by these physical priors, we design a disentanglement module to discriminate among different illumination degradation regions. Finally, we introduce the degradation-aware contrastive learning strategy to preserve semantic consistency across distinct degradation regions. Our method is evaluated on two public datasets, demonstrating a significant improvement in visual quality and considerable potential for benefiting downstream tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。