arXiv:2508.13547cs.CVeess.IV2025-08

轻量化生成人脸视频编码,参数减少90%仍保高质量。

A Lightweight Dual-Mode Optimization for Generative Face Video Coding

  • 用轻量结构替换传统卷积,降低模型复杂度。
  • 训练时软剪枝+推理前硬剪枝,实现88.9%计算节省。
  • 适合移动端等资源受限设备部署,性能优于VVC。

生成式人脸视频编码(GFVC)通过深度生成模型的强大推理能力,实现了优异的码率-失真性能。然而其实际部署受限于庞大的模型参数和高计算开销。为此,我们提出一种轻量化GFVC框架,引入双模式优化——结合架构重设计与操作优化,以降低复杂度并保持重建质量。在架构上,将传统的3×3卷积替换为更轻量高效的层,降低复杂度而不损失特征表达能力。在操作层面,提出两阶段自适应通道剪枝策略:(1) 训练阶段通过可学习阈值进行软剪枝,识别冗余通道;(2) 训练后使用推导掩码执行硬剪枝,永久移除冗余通道。该双阶段方法确保训练稳定性与推理高效性。实验表明,所提轻量化双模式优化相比基线可实现90.4%参数压缩和88.9%计算量节省,且在感知质量指标上优于当前最先进的视频编码标准VVC。因此,该方法有望推动GFVC在移动边缘设备等资源受限环境中的高效部署。

原文摘要 · Abstract (English)

Generative Face Video Coding (GFVC) achieves superior rate-distortion performance by leveraging the strong inference capabilities of deep generative models. However, its practical deployment is hindered by large model parameters and high computational costs. To address this, we propose a lightweight GFVC framework that introduces dual-mode optimization -- combining architectural redesign and operational refinement -- to reduce complexity whilst preserving reconstruction quality. Architecturally, we replace traditional 3 x 3 convolutions with slimmer and more efficient layers, reducing complexity without compromising feature expressiveness. Operationally, we develop a two-stage adaptive channel pruning strategy: (1) soft pruning during training identifies redundant channels via learnable thresholds, and (2) hard pruning permanently eliminates these channels post-training using a derived mask. This dual-phase approach ensures both training stability and inference efficiency. Experimental results demonstrate that the proposed lightweight dual-mode optimization for GFVC can achieve 90.4% parameter reduction and 88.9% computation saving compared to the baseline, whilst achieving superior performance compared to state-of-the-art video coding standard Versatile Video Coding (VVC) in terms of perceptual-level quality metrics. As such, the proposed method is expected to enable efficient GFVC deployment in resource-constrained environments such as mobile edge devices.

生成式编码轻量化模型人脸视频通道剪枝

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。