arXiv:2506.04054cs.CV2025-06

提出DAN网络,利用相邻帧信息有效提升视频去模糊效果。

Video Deblurring with Deconvolution and Aggregation Networks

  • 分三步:预处理、对齐去卷积、可靠性加权融合
  • 在公开数据集上优于现有最先进方法
  • 适合需要高质量视频去模糊的应用场景

与单图去模糊相比,视频去模糊可利用邻近帧信息来恢复目标帧。然而,现有方法未能充分挖掘邻近帧的潜力,导致性能受限。本文提出去卷积与聚合网络(DAN),通过三个子网络实现高效利用邻近帧:预处理网络(PPN)采用非局部操作处理模糊输入;对齐去卷积网络(ABDN)基于帧对齐进行去模糊;帧聚合网络(FAN)根据像素级清晰度可靠性图将去模糊结果融合为潜在帧。三者协同工作,使邻近帧信息得到合理利用。实验表明,DAN在公开数据集上的定量和定性评估中均优于现有最先进方法。

原文摘要 · Abstract (English)

In contrast to single-image deblurring, video deblurring has the advantage that neighbor frames can be utilized to deblur a target frame. However, existing video deblurring algorithms often fail to properly employ the neighbor frames, resulting in sub-optimal performance. In this paper, we propose a deconvolution and aggregation network (DAN) for video deblurring that utilizes the information of neighbor frames well. In DAN, both deconvolution and aggregation strategies are achieved through three sub-networks: the preprocessing network (PPN) and the alignment-based deconvolution network (ABDN) for the deconvolution scheme; the frame aggregation network (FAN) for the aggregation scheme. In the deconvolution part, blurry inputs are first preprocessed by the PPN with non-local operations. Then, the output frames from the PPN are deblurred by the ABDN based on the frame alignment. In the FAN, these deblurred frames from the deconvolution part are combined into a latent frame according to reliability maps which infer pixel-wise sharpness. The proper combination of three sub-networks can achieve favorable performance on video deblurring by using the neighbor frames suitably. In experiments, the proposed DAN was demonstrated to be superior to existing state-of-the-art methods through both quantitative and qualitative evaluations on the public datasets.

视频去模糊去卷积帧聚合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。