用语义编码提升无线视频传输效率，降低带宽消耗。
WVSC: Wireless Video Semantic Communication with Multi-frame Compensation
- 将视频转为语义帧进行编码，实现语义级传输
- 引入参考语义帧和多帧补偿，节省通信开销
- 相比传统方法提升2 dB PSNR，适合低带宽场景
现有无线视频传输方案在像素层面直接编码视频，忽略了视频内部蕴含的语义信息。本文提出一种无线视频语义通信框架WVSC，将语义通信思想融入无线视频传输。WVSC首先将原始视频帧编码为语义帧，再基于紧凑的语义表示进行视频编码，实现语义级而非像素级编码。为进一步降低通信开销，引入参考语义帧替代传统编码中的运动矢量。接收端采用多帧补偿（MFC）机制，通过多帧融合注意力模块生成补偿后的当前语义帧。结合参考帧传输与MFC，显著提升带宽效率并保持良好视频质量。实验表明，相比其他基于深度学习的方法（如DVSC）可获得约1 dB的PSNR增益，相比传统方案提升约2 dB。
原文摘要 · Abstract (English)
Existing wireless video transmission schemes directly conduct video coding in pixel level, while neglecting the inner semantics contained in videos. In this paper, we propose a wireless video semantic communication framework, abbreviated as WVSC, which integrates the idea of semantic communication into wireless video transmission scenarios. WVSC first encodes original video frames as semantic frames and then conducts video coding based on such compact representations, enabling the video coding in semantic level rather than pixel level. Moreover, to further reduce the communication overhead, a reference semantic frame is introduced to substitute motion vectors of each frame in common video coding methods. At the receiver, multi-frame compensation (MFC) is proposed to produce compensated current semantic frame with a multi-frame fusion attention module. With both the reference frame transmission and MFC, the bandwidth efficiency improves with satisfying video transmission performance. Experimental results verify the performance gain of WVSC over other DL-based methods e.g. DVSC about 1 dB and traditional schemes about 2 dB in terms of PSNR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。