arXiv:2506.10840cs.CVcs.AI2025-06

提出首个针对视频抠图的高效后训练量化框架,兼顾精度与时序一致性。

Post-Training Quantization for Video Matting

  • 分两阶段量化:先快速初始化,再全局校准参数以减少误差。
  • 引入统计驱动的全局仿射校准,使模型补偿累积失真,误差降低20%。
  • 结合光流引导,提升复杂场景中运动前景的区分能力,4比特接近全精度性能。

视频抠图在影视制作和虚拟现实等应用中至关重要,但其计算密集型模型在资源受限设备上的部署面临挑战。量化是模型压缩与加速的关键技术。作为高效方法,后训练量化(PTQ)在视频抠图领域仍处于起步阶段,难以兼顾精度与时序一致性。为此,本文提出首个专为视频抠图设计的系统性PTQ框架。贡献包括:(1) 两阶段量化策略:结合基于块重建的优化实现快速稳定初始量化,并捕捉局部依赖;随后通过全局量化参数校准最小化精度损失。(2) 统计驱动的全局仿射校准(GAC)方法,可补偿因忽略批归一化层效应等引起的累积统计失真,使现有方法误差最多降低20%。(3) 光流辅助(OFA)组件,利用帧间时空与语义先验指导量化过程,增强复杂场景中运动前景的区分能力,实现在超低比特下接近全精度性能。大量定量与可视化结果表明,所提PTQ4VM在不同比特宽度下均达到当前最优精度。尤其4比特版本性能接近全精度模型,同时获得8倍计算量节省。

原文摘要 · Abstract (English)

Video matting is crucial for applications such as film production and virtual reality, yet deploying its computationally intensive models on resource-constrained devices presents challenges. Quantization is a key technique for model compression and acceleration. As an efficient approach, Post-Training Quantization (PTQ) is still in its nascent stages for video matting, facing significant hurdles in maintaining accuracy and temporal coherence. To address these challenges, this paper proposes a novel and general PTQ framework specifically designed for video matting models, marking, to the best of our knowledge, the first systematic attempt in this domain. Our contributions include: (1) A two-stage PTQ strategy that combines block-reconstruction-based optimization for fast, stable initial quantization and local dependency capture, followed by a global calibration of quantization parameters to minimize accuracy loss. (2) A Statistically-Driven Global Affine Calibration (GAC) method that enables the network to compensate for cumulative statistical distortions arising from factors such as neglected BN layer effects, even reducing the error of existing PTQ methods on video matting tasks up to 20%. (3) An Optical Flow Assistance (OFA) component that leverages temporal and semantic priors from frames to guide the PTQ process, enhancing the model's ability to distinguish moving foregrounds in complex scenes and ultimately achieving near full-precision performance even under ultra-low-bit quantization. Comprehensive quantitative and visual results show that our PTQ4VM achieves the state-of-the-art accuracy performance across different bit-widths compared to the existing quantization methods. We highlight that the 4-bit PTQ4VM even achieves performance close to the full-precision counterpart while enjoying 8x FLOP savings.

视频抠图后训练量化模型压缩光流引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。