arXiv:2605.13476cs.CV2026-05中稿 · ISCAS 2026 as an o…被引 1

动态域迁移提升视频压缩泛化能力,节省6.21%码率

Neural Video Compression with Domain Transfer

论文配图:Neural Video Compression with Domain Transfer
图 1 · 摘自论文原文
  • 推理时动态调整编码特征,无需修改模型参数
  • 帧级率失真自适应调节,提升压缩效率6.21%
  • 适合跨场景视频压缩,尤其应对未见内容分布

内容自适应压缩是神经视频编码(NVC)的关键方向,旨在缓解训练与测试数据间的领域差异。这种差异常因数据分布不一致导致测试性能显著下降。为此,我们提出DCVC-DT框架,引入轻量级在线域迁移(DT)机制,在推理阶段动态调整编码特征表示,有效弥合领域差距,且不改变编码器或解码器参数。同时,设计帧级动态率失真(RD)调节方案,根据质量波动主动调整损失函数中率与失真的比例,从而提升率失真性能。大量实验表明,相较于基线模型DCVC-DC,DCVC-DT在保持高质量的同时实现最高6.21%的码率节省,显著增强对未见测试数据的泛化能力,并有效缓解误差传播问题。代码已开源。

原文摘要 · Abstract (English)

Content-adaptive compression has always been a key direction in neural video coding (NVC), aiming to mitigate the domain gap between training and testing data. Such gaps often arise from distributional discrepancies between training and inference data, which may cause noticeable performance degradation when the testing content differs from the training distribution. To tackle this challenge, we propose DCVC-DT, a domain transfer enhanced neural video compression framework. Specifically, we design a lightweight online domain transfer (DT) mechanism that dynamically adapts the encoded latent representation during inference, effectively bridging the domain gap without modifying the encoder or decoder parameters. In addition, we develop a frame-level dynamic RD (Rate and Distortion) adjustment scheme that actively regulates the ratio of R and D in the loss function based on quality fluctuation, thereby improving rate-distortion performance. Extensive experiments demonstrate that DCVC-DT achieves up to 6.21% bitrate savings over the baseline DCVC-DC, while significantly enhancing generalization to unseen testing data and alleviating error propagation. Our code is available at https://github.com/SunnyMass/DCVC-DT.

视频压缩域迁移神经编码率失真优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。