用生成模型重构图像,让无线通信更懂人眼感知。
JSCGC: Joint Source-Channel-Generation Coding for Wireless Generative Communications

- 接收端用生成模型根据信号采样,不再追求精确还原。
- 在不同信道下均提升图像语义和分布质量,误差表现为语义错乱。
- 适合对视觉真实感要求高的无线图像传输场景。
传统通信系统基于香农率-失真理论设计,依赖通用失真度量,难以捕捉复杂的人类视觉感知,常导致重建图像模糊或不真实。本文提出联合源-信道-生成编码(JSCGC),将接收端的解码器替换为生成模型。接收信号作为条件控制生成过程,从最小化失真转向在感知约束下最大化互信息。基于此框架,我们构建统一训练与高效随机采样方法,并提供学习与推理阶段的理论分析。在潜在空间图像传输上的大量实验表明,JSCGC在多种信道条件下持续提升特征级、语义级和分布质量,且错误行为表现为语义不一致而非失真。
原文摘要 · Abstract (English)
Conventional communication systems, including both separation-based coding and learning-based joint source-channel coding (JSCC), are typically designed under Shannon's rate-distortion theory. However, relying on generic distortion metrics fails to capture complex human visual perception, often resulting in blurred or unrealistic reconstructions. In this paper, we propose Joint Source-Channel-Generation Coding (JSCGC), a generative communication paradigm that replaces the conventional decoder with a generative model at the receiver. The received signal is treated as a condition that controls the sampling process into the learned conditional distribution, reformulating communication from deterministic reconstruction for distortion minimization to controlled generation for mutual information maximization under perceptual constraints. Based on this formulation, we develop a unified joint training and efficient stochastic sampling framework, and provide theoretical analysis of its effectiveness in both learning and inference stages. Extensive experiments on latent-space image transmission demonstrate that the JSCGC consistently improves feature-based, semantic-level, and distributional quality across diverse channel conditions, while exhibiting a distinct error behavior characterized by semantic inconsistency rather than distortion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。