arXiv:2503.09013cs.CV2025-03被引 9

用循环提示提升各种恶劣天气图像修复效果

Prompt to Restore, Restore to Prompt: Cyclic Prompting for Universal Adverse Weather Removal

  • 设计循环提示框架,融合天气信息与上下文特征
  • 在合成与真实数据集上均超越现有方法
  • 适合需要通用天气修复的计算机视觉应用

通用恶劣天气图像修复(UAWR)旨在统一框架下处理多种天气退化问题。受预训练视觉-语言模型(如CLIP)启发,近期方法采用退化感知提示来促进无天气图像恢复,取得显著进展。本文提出CyclicPrompt,一种创新的循环提示方法,以增强UAWR的有效性、适应性和泛化能力。CyclicPrompt包含两个关键组件:1)复合上下文提示,将天气相关信息与上下文感知表征整合到网络中,引导修复过程;该提示通过结合可学习的输入条件向量与天气特定知识,提升了对各类退化的适应能力。2)擦除-粘贴机制,在初步修复后,用约束的恢复先验替换天气特定知识,将高质量无天气概念注入复合提示,进一步优化修复流程。由此形成‘提示-修复-提示’的循环管道,有效利用天气知识、文本上下文和可靠纹理。在合成与真实世界数据集上的大量实验验证了CyclicPrompt的优越性能。代码已开源:https://github.com/RongxinL/CyclicPrompt。

原文摘要 · Abstract (English)

Universal adverse weather removal (UAWR) seeks to address various weather degradations within a unified framework. Recent methods are inspired by prompt learning using pre-trained vision-language models (e.g., CLIP), leveraging degradation-aware prompts to facilitate weather-free image restoration, yielding significant improvements. In this work, we propose CyclicPrompt, an innovative cyclic prompt approach designed to enhance the effectiveness, adaptability, and generalizability of UAWR. CyclicPrompt Comprises two key components: 1) a composite context prompt that integrates weather-related information and context-aware representations into the network to guide restoration. This prompt differs from previous methods by marrying learnable input-conditional vectors with weather-specific knowledge, thereby improving adaptability across various degradations. 2) The erase-and-paste mechanism, after the initial guided restoration, substitutes weather-specific knowledge with constrained restoration priors, inducing high-quality weather-free concepts into the composite prompt to further fine-tune the restoration process. Therefore, we can form a cyclic "Prompt-Restore-Prompt" pipeline that adeptly harnesses weather-specific knowledge, textual contexts, and reliable textures. Extensive experiments on synthetic and real-world datasets validate the superior performance of CyclicPrompt. The code is available at: https://github.com/RongxinL/CyclicPrompt.

图像修复提示学习天气去噪循环机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。