arXiv:2509.09494eess.IVcs.CV2025-09被引 2

用查表法实现视频编码中的高效去噪,兼顾质量与速度。

In-Loop Filtering Using Learned Look-Up Tables for Video Coding

  • 用训练好的神经网络生成查找表,编码时直接查表并插值过滤像素。
  • 在VVC测试中平均节省0.82%~4.11%码率,效果接近神经网络方案。
  • 支持多通道联合索引与表压缩,适合实际部署,硬件开销极低。

环内滤波(ILF)是视频编码标准中降低伪影、提升视觉质量的关键技术。近年来基于神经网络的ILF方案虽取得显著编码增益,但存在计算复杂度高、对专用硬件依赖强的问题。为此,本文提出一种基于查找表(LUT)的实用型ILF框架——LUT-ILF++。首先,引入多种滤波LUT协同工作,并设计定制化索引机制,在有限存储下增强参考感知能力;其次,提出跨分量索引机制,实现不同颜色分量的联合滤波;第三,设计LUT压缩方案,实现表项剪枝,降低整体存储成本。该框架在VVC参考软件中实现。实验表明,在AI和RA配置下,对通用测试序列平均分别获得0.82%/2.97%/1.63%和0.85%/4.11%/2.06%的码率降低。相比基于DNN的方案,本方法时间复杂度与存储开销显著更低。

原文摘要 · Abstract (English)

In-loop filtering (ILF) is a key technology in video coding standards to reduce artifacts and enhance visual quality. Recently, neural network-based ILF schemes have achieved remarkable coding gains, emerging as a powerful candidate for next-generation video coding standards. However, the use of deep neural networks (DNN) brings significant computational and time complexity or high demands for dedicated hardware, making it challenging for general use. To address this limitation, we study a practical ILF solution by adopting look-up tables (LUTs). After training a DNN with a restricted reference range for ILF, all possible inputs are traversed, and the output values of the DNN are cached into LUTs. During the coding process, the filtering process is performed by simply retrieving the filtered pixel through locating the input pixels and interpolating between the cached values, instead of relying on heavy inference computations. In this paper, we propose a universal LUT-based ILF framework, termed LUT-ILF++. First, we introduce the cooperation of multiple kinds of filtering LUTs and propose a series of customized indexing mechanisms to enable better filtering reference perception with limited storage consumption. Second, we propose the cross-component indexing mechanism to enable the filtering of different color components jointly. Third, in order to make our solution practical for coding uses, we propose the LUT compaction scheme to enable the LUT pruning, achieving a lower storage cost of the entire solution. The proposed framework is implemented in the VVC reference software. Experimental results show that the proposed framework achieves on average 0.82%/2.97%/1.63% and 0.85%/4.11%/2.06% bitrate reduction for common test sequences, under the AI and RA configurations, respectively. Compared to DNN-based solutions, our proposed solution has much lower time complexity and storage cost.

视频编码查表法低延迟LUT优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。