arXiv:2505.16434cs.CVcs.MM2025-05ICCV被引 2

通过流与特征联合优化,提升视频修复的时序一致性。

Joint Flow And Feature Refinement Using Attention For Video Restoration

  • 交替优化光流与特征,多尺度协同增强
  • 在去噪/去模糊/超分任务中最高提升1.62 dB
  • 适合需要稳定时序表现的视频修复场景

视频修复近年聚焦于从低质量输入恢复高质量帧。相比静态图像,视频修复性能高度依赖帧间时序相关性的有效利用。现有方法多采用基于光流或循环结构的时序策略,但常因使用退化的输入帧而难以保持时序一致性。为此,本文提出一种名为联合流与特征精炼注意力(JFFRA)的新框架。该框架核心思想是通过流(对齐)与修复的迭代协同,逐步提升数据质量。利用已增强的特征来精炼光流,反之亦然,实现高效特征增强。这种流与修复的交互在多尺度上进行,降低对精确光流估计的依赖。此外,引入遮挡感知的时序损失函数,提升消除闪烁伪影的能力。大量实验验证了JFFRA在去噪、去模糊和超分辨率等任务中的通用性,相较当前最优方法,峰值信噪比最高提升1.62 dB。

原文摘要 · Abstract (English)

Recent advancements in video restoration have focused on recovering high-quality video frames from low-quality inputs. Compared with static images, the performance of video restoration significantly depends on efficient exploitation of temporal correlations among successive video frames. The numerous techniques make use of temporal information via flow-based strategies or recurrent architectures. However, these methods often encounter difficulties in preserving temporal consistency as they utilize degraded input video frames. To resolve this issue, we propose a novel video restoration framework named Joint Flow and Feature Refinement using Attention (JFFRA). The proposed JFFRA is based on key philosophy of iteratively enhancing data through the synergistic collaboration of flow (alignment) and restoration. By leveraging previously enhanced features to refine flow and vice versa, JFFRA enables efficient feature enhancement using temporal information. This interplay between flow and restoration is executed at multiple scales, reducing the dependence on precise flow estimation. Moreover, we incorporate an occlusion-aware temporal loss function to enhance the network's capability in eliminating flickering artifacts. Comprehensive experiments validate the versatility of JFFRA across various restoration tasks such as denoising, deblurring, and super-resolution. Our method demonstrates a remarkable performance improvement of up to 1.62 dB compared to state-of-the-art approaches.

视频修复光流注意力机制时序一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。