提出快速稀疏二次变换,提升视频编码效率并大幅降低计算量。
FaSST: Fast Sparsifying Secondary Transform

- 用Givens旋转分解稀疏正交变换,实现低复杂度自适应设计。
- 在AV2编码中应用,计算量减少83.67%,仍保持与LFNST相当的压缩性能。
- 避免固定系数截断,相比LFNST最多节省1.80%码率,适合高效视频编码场景。
数据相关二次变换旨在消除可分主变换系数间的相关性,从而提升残差编码效率;然而其部署常受限于计算复杂度。现有视频编码器采用低频非可分变换(LFNST)变体,会丢弃部分高频二次变换系数,限制了编码增益。此外,现有数据相关二次变换缺乏显式的率失真(RD)最优设计准则。本文提出一种低复杂度数据依赖二次变换设计框架,称为快速稀疏二次变换(FaSST)。该方法通过将数据驱动的稀疏正交变换(SOTs)分解为一系列Givens旋转来近似实现,并采用交替优化结合近似Givens分解策略高效确定旋转参数。方法根据预测模式自适应调整旋转数量,进一步降低计算开销。我们为AV2中的帧内预测残差设计了模式自适应的二次变换。实验结果表明,模式自适应的FaSST在保持与LFNST相当的率失真性能的同时,计算量降低了83.67%。此外,通过避免固定系数截断,FaSST相较LFNST最多实现1.80%的BD-rate节省,且计算复杂度仅为后者的66.24%。
原文摘要 · Abstract (English)
Data-dependent secondary transforms, which aim to decorrelate coefficients of a separable primary transform, can improve residual coding efficiency; however, their deployment is often constrained by computational complexity. Recent video codecs use variants of the low-frequency non-separable transform (LFNST), which discards some high-frequency secondary transform coefficients, limiting achievable coding gains. Moreover, existing data-dependent secondary transforms lack explicit rate-distortion (RD) optimal design criteria. In this work, we propose a framework for designing low-complexity data-dependent secondary transforms, termed Fast Sparsifying Secondary Transforms (FaSSTs). Our approach approximates data-driven sparse orthonormal transforms (SOTs) by factorizing them into a sequence of Givens rotations. The rotations are efficiently determined using an alternating minimization strategy combined with an approximate Givens factorization procedure. Our method adapts the number of rotations based on the prediction mode, further reducing computational complexity. We design mode-dependent secondary transforms for intra-prediction residuals in AV2 using FaSST. Experimental results show that mode-adaptive FaSST matches the RD performance of LFNST while reducing the number of computations by 83.67%. Moreover, by avoiding fixed-coefficient truncation, FaSST achieves up to 1.80% BD-rate savings relative to LFNST while operating at 66.24% lower complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。