arXiv:2601.00533cs.CV2026-01被引 1

统一处理视频中随时间平滑演化的未知退化,提升恢复质量与连贯性。

All-in-One Video Restoration under Smoothly Evolving Unknown Weather Degradations

  • 设计动态退化提示机制,结合静态与动态提示捕捉退化类型与强度变化。
  • 在真实退化场景下,相比基线模型,视频恢复质量提升1.2~2.3dB,时序一致性更强。
  • 适合需要应对复杂、渐变退化的真实视频修复任务,如监控、无人机影像。

全合一图像复原旨在用单一模型从多种未知退化中恢复清晰图像。但将该任务扩展到视频面临独特挑战:现有方法主要关注帧间退化差异,忽略了真实退化过程中固有的时序连续性。实际上,退化类型与强度会随时间平滑演变,多种退化可能共存或渐变过渡。本文提出平滑演化的未知退化(SEUD)场景,其中活跃退化集合与退化强度随时间持续变化。为此,我们设计了一个灵活的合成管道,生成具有单一分解、复合及演化退化的时序一致视频。针对SEUD场景,提出全一型循环条件自适应提示网络(ORCANet)。首先,粗强度估计去雾(CIED)模块利用物理先验估计雾浓度,并提供粗去雾特征作为初始化。其次,流提示生成(FPG)模块提取退化特征,生成既包含段级退化类型的静态提示,又适应帧级强度变化的动态提示。此外,标签感知监督机制增强了不同退化下的静态提示表征可区分性。大量实验表明,ORCANet在恢复质量、时序一致性和鲁棒性方面均优于基于图像和视频的基线模型。代码已公开于 https://github.com/Friskknight/ORCANet-SEUD。

原文摘要 · Abstract (English)

All-in-one image restoration aims to recover clean images from diverse unknown degradations using a single model. But extending this task to videos faces unique challenges. Existing approaches primarily focus on frame-wise degradation variation, overlooking the temporal continuity that naturally exists in real-world degradation processes. In practice, degradation types and intensities evolve smoothly over time, and multiple degradations may coexist or transition gradually. In this paper, we introduce the Smoothly Evolving Unknown Degradations (SEUD) scenario, where both the active degradation set and degradation intensity change continuously over time. To support this scenario, we design a flexible synthesis pipeline that generates temporally coherent videos with single, compound, and evolving degradations. To address the challenges in the SEUD scenario, we propose an all-in-One Recurrent Conditional and Adaptive prompting Network (ORCANet). First, a Coarse Intensity Estimation Dehazing (CIED) module estimates haze intensity using physical priors and provides coarse dehazed features as initialization. Second, a Flow Prompt Generation (FPG) module extracts degradation features. FPG generates both static prompts that capture segment-level degradation types and dynamic prompts that adapt to frame-level intensity variations. Furthermore, a label-aware supervision mechanism improves the discriminability of static prompt representations under different degradations. Extensive experiments show that ORCANet achieves superior restoration quality, temporal consistency, and robustness over image and video-based baselines. Code is available at https://github.com/Friskknight/ORCANet-SEUD.

视频修复退化建模时序一致性自适应提示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。