提出变分源信道编码,让语义通信更懂人话、更省带宽。
Variational Source-Channel Coding for Semantic Communication
- 用变分推断融合信道特性,构建新型语义通信框架
- 在相同失真下,人眼可读性比VAE高,潜变量方差揭示语义特征
- 适合追求可解释性和高效语义传输的研究者
语义通信技术作为连接人工智能与经典通信的桥梁正日益重要。当前系统多采用自编码器(AE)模型,但其难以有效捕捉信道动态,导致无法合理解释联合源信道编码(JSCC)的必要性及性能提升原因。本文从无损与有损通信出发,指出数据失真使语义通信区别于经典通信,破坏了分离定理成立条件,因而语义通信传输数据量更少,必须采用JSCC才能实现最优性能。为此,提出变分源信道编码(VSCC)方法,基于数据失真理论,融合变分推断与信道特性。通过深度网络实现的VSCC系统成功完成语义传输。对比同等复杂度的AE与VAE系统,实验表明:VSCC模型具有更强可解释性,能清晰体现传输数据的语义特征(表现为潜变量方差);在相同PSNR失真水平下,其人类可读性优于VAE,部分可通过SSIM评估。
原文摘要 · Abstract (English)
Semantic communication technology emerges as a pivotal bridge connecting AI with classical communication. The current semantic communication systems are generally modeled as an Auto-Encoder (AE). AE lacks a deep integration of AI principles with communication strategies due to its inability to effectively capture channel dynamics. This gap makes it difficult to justify the need for joint source-channel coding (JSCC) and to explain why performance improves. This paper begins by exploring lossless and lossy communication, highlighting that the inclusion of data distortion distinguishes semantic communication from classical communication. It breaks the conditions for the separation theorem to hold and explains why the amount of data transferred by semantic communication is less. Therefore, employing JSCC becomes imperative for achieving optimal semantic communication. Moreover, a Variational Source-Channel Coding (VSCC) method is proposed for constructing semantic communication systems based on data distortion theory, integrating variational inference and channel characteristics. Using a deep learning network, we develop a semantic communication system employing the VSCC method and demonstrate its capability for semantic transmission. We also establish semantic communication systems of equivalent complexity employing the AE method and the VAE method. Experimental results reveal that the VSCC model offers superior interpretability compared to AE model, as it clearly captures the semantic features of the transmitted data, represented as the variance of latent variables in our experiments. In addition, VSCC model exhibits superior semantic transmission capabilities compared to VAE model. At the same level of data distortion evaluated by PSNR, VSCC model exhibits stronger human interpretability, which can be partially assessed by SSIM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。