用单一模型同时去雨、去雪、去雾,效果更优且适应性强。
DDTNet: Degradation Disentanglement and Transfer Network for Test-Time All-in-One De-weathering Adaptation

- 分离降质模式并迁移至干净图像,生成适配新场景的训练数据。
- 在真实世界数据集上显著提升去雨、去雪、去雾性能,稳定增强。
- 适合需要跨天气、跨场景自适应的图像修复任务使用。
全场景恶劣天气图像修复旨在使用单一统一模型去除雨、雾、雪等多种退化。尽管应用广泛,现有方法通常在各类退化类型上表现平衡但次优。当训练与测试数据存在领域差异时,该问题更加明显。受‘建模退化模式比恢复清晰内容更可行’的启发,本文提出退化解耦与迁移网络(DDTNet),专注于退化模式的迁移。通过从目标域退化图像中解耦退化模式,并将其迁移至源域干净图像,DDTNet生成领域自适应的成对训练数据。这些数据用于微调修复模型,显著提升其在多种天气条件和领域间的适应能力。核心是退化解耦模块(DDM),包含退化耦合注意力(DCA),可同时捕捉通用与天气特异性特征,实现有效解耦与迁移。实验表明,DDTNet在真实世界去雨、去雪、去雾数据集上持续显著提升现有全场景模型性能。
原文摘要 · Abstract (English)
All-in-one adverse weather image restoration aims to remove multiple degradations, such as rain, haze, and snow, using a single unified model. Despite their broad applicability, existing methods typically compromise performance, delivering balanced but suboptimal results for individual degradation types. This issue becomes more pronounced when a domain gap exists between training and testing data. Motivated by the observation that modeling degradation patterns is more feasible than recovering clean content, we propose the Degradation Disentanglement and Transfer Network (DDTNet), which focuses specifically on degradation transfer. By disentangling degradation patterns from target-domain degraded images and transferring them to source domain clean images, DDTNet generates domain-adaptive paired training data. These pairs are then used to fine-tune restoration models, significantly enhancing their adaptability across diverse weather conditions and domains. The core of DDTNet is the Degradation Disentanglement Module (DDM), which comprises Degradation Coupled Attention (DCA) to capture both general and weather-specific features, thereby enabling effective disentanglement and transfer of degradation patterns. Experimental results demonstrate that DDTNet significantly and consistently improves existing all-in-one models across real-world deraining, desnowing, and dehazing datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。