解决夜间多天气叠加模糊问题,一次还原真实复杂光照下的清晰图像。
Clear Nights Ahead: Towards Multi-Weather Nighttime Image Restoration
- 引入基于Retinex的双先验机制,分别聚焦光照不均与纹理细节。
- 提出天气感知动态协同模块,自适应处理多种天气混合退化。
- 构建大规模夜间多天气数据集AllWeatherNight,支持真实场景研究。
夜间图像受多重恶劣天气和复杂光照影响,修复难度高且研究较少。本文首次系统探索多天气夜间图像恢复任务,提出大型高质量合成数据集AllWeatherNight,通过光照感知的退化生成方法构建多样化的复合退化图像。为此设计统一的ClearNight框架,利用基于Retinex的双先验提取不均匀光照区域与内在纹理信息,并引入天气感知动态特定-共性协同机制,识别不同天气退化并自适应选择对应最优单元。实验表明,ClearNight在合成与真实图像上均达到当前最佳性能。消融实验证明了数据集与框架的有效性。
原文摘要 · Abstract (English)
Restoring nighttime images affected by multiple adverse weather conditions is a practical yet under-explored research problem, as multiple weather conditions often coexist in the real world alongside various lighting effects at night. This paper first explores the challenging multi-weather nighttime image restoration task, where various types of weather degradations are intertwined with flare effects. To support the research, we contribute the AllWeatherNight dataset, featuring large-scale high-quality nighttime images with diverse compositional degradations, synthesized using our introduced illumination-aware degradation generation. Moreover, we present ClearNight, a unified nighttime image restoration framework, which effectively removes complex degradations in one go. Specifically, ClearNight extracts Retinex-based dual priors and explicitly guides the network to focus on uneven illumination regions and intrinsic texture contents respectively, thereby enhancing restoration effectiveness in nighttime scenarios. In order to better represent the common and unique characters of multiple weather degradations, we introduce a weather-aware dynamic specific-commonality collaboration method, which identifies weather degradations and adaptively selects optimal candidate units associated with specific weather types. Our ClearNight achieves state-of-the-art performance on both synthetic and real-world images. Comprehensive ablation experiments validate the necessity of AllWeatherNight dataset as well as the effectiveness of ClearNight. Project Page: https://henlyta.github.io/ClearNight/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。