提出新型神经视频传输方法,解决误差累积问题并提升压缩效率。
Deep Joint Source-Channel Coding for Wireless Video Transmission with Asymmetric Context
- 用非对称上下文引导编码解码条件学习,无需模拟传输管道。
- 引入特征传播机制,有效利用时序相关性并减少误差累积。
- 支持自适应编码,实现可变带宽传输,适合动态网络环境。
本文提出一种高效深度联合源信道编码(JSCC)方法,用于无线视频传输,基于带有非对称上下文的条件编码。传统基于条件编码的神经视频压缩需从相同上下文中预测编解码条件,而伪模拟传输类的JSCC方案中,编码器无法获取与解码器相同的重建帧,即便构建了模拟传输路径也难以实现。所提方法无需该路径,通过设计神经网络从非对称上下文中学习编码与解码条件。同时引入特征传播机制,使中间特征在编码器与解码器端独立传播,辅助条件生成,显著利用时序相关性并缓解误差累积问题。为进一步提升性能,采用内容自适应编码,结合熵模型与掩码机制实现可变带宽传输。实验表明,本方法在性能上优于现有深度视频传输框架,有效抑制误差累积,减少关键帧插入频率,从而进一步提升整体表现。
原文摘要 · Abstract (English)
In this paper, we propose a high-efficiency deep joint source-channel coding (JSCC) method for video transmission based on conditional coding with asymmetric context. The conditional coding-based neural video compression requires to predict the encoding and decoding conditions from the same context which includes the same reconstructed frames. However in JSCC schemes which fall into pseudo-analog transmission, the encoder cannot infer the same reconstructed frames as the decoder even a pipeline of the simulated transmission is constructed at the encoder. In the proposed method, without such a pipeline, we guide and design neural networks to learn encoding and decoding conditions from asymmetric contexts. Additionally, we introduce feature propagation, which allows intermediate features to be independently propagated at the encoder and decoder and help to generate conditions, enabling the framework to greatly leverage temporal correlation while mitigating the problem of error accumulation. To further exploit the performance of the proposed transmission framework, we implement content-adaptive coding which achieves variable bandwidth transmission using entropy models and masking mechanisms. Experimental results demonstrate that our method outperforms existing deep video transmission frameworks in terms of performance and effectively mitigates the error accumulation. By mitigating the error accumulation, our schemes can reduce the frequency of inserting intra-frame coding modes, further enhancing performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。