用伪标签指导修复模糊天气图像,解决训练数据不匹配问题。
Pseudo-Label Guided Real-World Image De-weathering: A Learning Framework with Imperfect Supervision
- 通过伪标签与真实图像联合监督,自适应修复纹理并保持内容一致性。
- 跨帧相似性聚合模块提升伪标签质量,利用多帧互补信息。
- 适合处理真实场景中光照、位置不一致的天气退化图像修复任务。
真实世界图像去天气化旨在去除雨、雪、雾等天气相关伪影。理想训练数据对至关重要,现有数据集通常从网络直播中提取清晰与退化图像配对。尽管采集时有严格过滤,训练对仍存在光照、物体位置、场景细节等不一致,导致模型在非理想监督下产生形变伪影。本文提出一种伪标签引导的学习框架,解决真实配对数据中的多种不一致性。该框架包含去天气化模型(De-W)和一致标签构造器(CLC),通过原始真实图像恢复锐利纹理,并利用伪标签监督保持退化输入中非天气内容的一致性。特别地,CLC中引入跨帧相似性聚合(CSA)模块,通过图模型挖掘多帧间潜在互补信息以增强伪标签质量。此外,设计信息分配策略(IAS),融合原始真实图像与伪标签,实现对去天气化模型的联合监督。大量实验表明,本方法在不完美对齐的去天气化数据集上训练时,相比其他方法具有显著优势。
原文摘要 · Abstract (English)
Real-world image de-weathering aims at removingvarious undesirable weather-related artifacts, e.g., rain, snow,and fog. To this end, acquiring ideal training pairs is crucial.Existing real-world datasets are typically constructed paired databy extracting clean and degraded images from live streamsof landscape scene on the Internet. Despite the use of strictfiltering mechanisms during collection, training pairs inevitablyencounter inconsistency in terms of lighting, object position, scenedetails, etc, making de-weathering models possibly suffer fromdeformation artifacts under non-ideal supervision. In this work,we propose a unified solution for real-world image de-weatheringwith non-ideal supervision, i.e., a pseudo-label guided learningframework, to address various inconsistencies within the realworld paired dataset. Generally, it consists of a de-weatheringmodel (De-W) and a Consistent Label Constructor (CLC), bywhich restoration result can be adaptively supervised by originalground-truth image to recover sharp textures while maintainingconsistency with the degraded inputs in non-weather contentthrough the supervision of pseudo-labels. Particularly, a Crossframe Similarity Aggregation (CSA) module is deployed withinCLC to enhance the quality of pseudo-labels by exploring thepotential complementary information of multi-frames throughgraph model. Moreover, we introduce an Information AllocationStrategy (IAS) to integrate the original ground-truth imagesand pseudo-labels, thereby facilitating the joint supervision forthe training of de-weathering model. Extensive experimentsdemonstrate that our method exhibits significant advantageswhen trained on imperfectly aligned de-weathering datasets incomparison with other approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。