用语义级传输+扩散补偿，降低无线视频通信带宽需求
Wireless Video Semantic Communication with Decoupled Diffusion Multi-frame Compensation
- 将视频编码从像素级转为语义级，用紧凑表示代替原始帧
- 引入参考语义帧替代运动矢量，通信开销减少1.8 dB PSNR增益
- 适合低带宽场景下的高清视频传输，尤其适用于深度学习方案
现有无线视频传输方案在像素层面进行编码，忽略了视频中的内在语义。本文提出一种无线视频语义通信框架——解耦扩散多帧补偿（WVSC-D），将语义通信思想融入无线视频传输。WVSC-D首先将原始视频帧编码为语义帧，基于这些紧凑表示进行语义级视频编码，而非像素级。为进一步降低通信开销，引入参考语义帧替代传统视频编码中的运动矢量。接收端采用两阶段条件扩散过程的DDMFC生成补偿后的当前语义帧。通过参考帧传输与帧补偿结合，显著提升带宽效率并保持良好视频传输性能。实验表明，相较于其他基于深度学习的方法（如DVSC），WVSC-D在PSNR上提升约1.8 dB。
原文摘要 · Abstract (English)
Existing wireless video transmission schemes directly conduct video coding in pixel level, while neglecting the inner semantics contained in videos. In this paper, we propose a wireless video semantic communication framework with decoupled diffusion multi-frame compensation (DDMFC), abbreviated as WVSC-D, which integrates the idea of semantic communication into wireless video transmission scenarios. WVSC-D first encodes original video frames as semantic frames and then conducts video coding based on such compact representations, enabling the video coding in semantic level rather than pixel level. Moreover, to further reduce the communication overhead, a reference semantic frame is introduced to substitute motion vectors of each frame in common video coding methods. At the receiver, DDMFC is proposed to generate compensated current semantic frame by a two-stage conditional diffusion process. With both the reference frame transmission and DDMFC frame compensation, the bandwidth efficiency improves with satisfying video transmission performance. Experimental results verify the performance gain of WVSC-D over other DL-based methods e.g. DVSC about 1.8 dB in terms of PSNR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。