arXiv:2504.15380cs.CV2025-04CVPR被引 7

利用压缩码流信息提升压缩视频质量,适配多种场景。

Plug-and-Play Versatile Compressed Video Enhancement

  • 通过码流感知机制自适应调整增强网络参数。
  • 在多个压缩设置下显著提升视频质量,优于现有方法。
  • 可作为即插即用模块,助力下游视觉任务。

视频压缩广泛用于数据传输,虽降低文件大小,但损害视觉质量,影响下游视觉模型的鲁棒性。本文提出一种通用的码流感知增强框架,复用压缩码流信息,在不同压缩设置下自适应增强视频,不引入计算瓶颈,辅助各类下游视觉任务。该框架包含压缩感知适配(CAA)网络,采用分层适配机制估计逐帧增强网络(BAE)的参数;BAE网络进一步利用码流中嵌入的时空先验信息,有效提升压缩输入帧的质量。大量实验表明,本框架在视频质量增强上优于现有方法,并在多个下游任务中表现出卓越的通用性。代码与模型已公开于https://huimin-zeng.github.io/PnP-VCVE/。

原文摘要 · Abstract (English)

As a widely adopted technique in data transmission, video compression effectively reduces the size of files, making it possible for real-time cloud computing. However, it comes at the cost of visual quality, posing challenges to the robustness of downstream vision models. In this work, we present a versatile codec-aware enhancement framework that reuses codec information to adaptively enhance videos under different compression settings, assisting various downstream vision tasks without introducing computation bottleneck. Specifically, the proposed codec-aware framework consists of a compression-aware adaptation (CAA) network that employs a hierarchical adaptation mechanism to estimate parameters of the frame-wise enhancement network, namely the bitstream-aware enhancement (BAE) network. The BAE network further leverages temporal and spatial priors embedded in the bitstream to effectively improve the quality of compressed input frames. Extensive experimental results demonstrate the superior quality enhancement performance of our framework over existing enhancement methods, as well as its versatility in assisting multiple downstream tasks on compressed videos as a plug-and-play module. Code and models are available at https://huimin-zeng.github.io/PnP-VCVE/.

视频增强码流感知即插即用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。