用最优传输直接从语义生成图像,减少失真和计算开销。
Optimally Bridging Semantics and Data: Generative Semantic Communication via Schrödinger Bridge

- 基于薛定谔桥构建任意分布间最优传输路径,突破高斯限制
- 相比现有方法,FID降低38%以上,SSIM提升49.3%,推理提速超8倍
- 适合通信受限场景下的高效图像生成,尤其关注低带宽噪声信道
生成式语义通信(GSC)是窄带高噪声信道上图像传输的有前景方案。然而,现有GSC方法依赖从高斯分布到图像分布的长而间接的传输路径,受语义引导,导致严重幻觉且计算成本高。为此,本文提出通用框架——基于薛定谔桥的GSC(SBGSC)。通过薛定谔桥(SB)构建任意分布间的最优传输路径,SBGSC突破高斯分布限制,实现从语义到图像的直接生成解码。在此框架下,设计了基于扩散模型的薛定谔桥GSC(DSBGSC)。DSBGSC利用薛定谔势重构扩散模型的非线性漂移项,实现直接最优分布传输,有效降低幻觉与计算开销。为进一步加速生成,提出自一致性目标,引导模型学习指向图像的非线性速度场,跳过马尔可夫噪声预测,显著减少采样步数。仿真结果表明,DSBGSC优于当前最先进GSC方法,FID至少提升38%,SSIM提升49.3%,推理速度提升超过8倍。
原文摘要 · Abstract (English)
Generative Semantic Communication (GSC) is a promising solution for image transmission over narrow-band and high-noise channels. However, existing GSC methods rely on long, indirect transport trajectories from a Gaussian to an image distribution guided by semantics, causing severe hallucination and high computational cost. To address this, we propose a general framework named Schrödinger Bridge-based GSC (SBGSC). By leveraging the Schrödinger Bridge (SB) to construct optimal transport trajectories between arbitrary distributions, SBGSC breaks Gaussian limitations and enables direct generative decoding from semantics to images. Within this framework, we design Diffusion SB-based GSC (DSBGSC). DSBGSC reconstructs the nonlinear drift term of diffusion models using Schrödinger potentials, achieving direct optimal distribution transport to reduce hallucinations and computational overhead. To further accelerate generation, we propose a self-consistency-based objective guiding the model to learn a nonlinear velocity field pointing directly toward the image, bypassing Markovian noise prediction to significantly reduce sampling steps. Simulation results demonstrate that DSBGSC outperforms state-of-the-art GSC methods, improving FID by at least 38% and SSIM by 49.3%, while accelerating inference speed by over 8 times.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。