arXiv:2608.19590eess.IV2026-08中稿 · appear in IEEE TMC

在极低带宽下,让图像传输更抗丢包,提升画质保真度。

Loss-Resilient Semantic Communication over Packet-Loss Networks at Extreme-Low Bandwidth

论文配图:Loss-Resilient Semantic Communication over Packet-Loss Networks at Extreme-Low Bandwidth
图 1 · 摘自论文原文
  • 用语言模型增强隐空间上下文建模,缓解误差传播。
  • 支持动态丢包场景,保持图像感知质量与真实感。
  • 适合极端低带宽、高丢包的视觉通信应用。

在极低带宽网络中,生成式语义编码器已成为降低视觉通信带宽开销的有前景方案。然而,这些学习型编码器通常仅优化压缩效率,对传输错误缺乏鲁棒性。高度紧凑的生成式隐空间表示在包丢失时易受破坏,且因隐空间上下文和多步解码过程中的严重误差传播,导致保真度与真实感显著下降。本文提出ResiGLC,一种专为极低带宽丢包网络设计的鲁棒生成式隐空间编码框架。受生成与压缩间目标一致性的启发,我们充分利用语言模型强大的上下文预测能力,并结合掩码学习策略,实现对隐码的任意上下文建模,从而减轻误差传播并应对不可预测的丢包模式。接收端采用渐进式鲁棒解码流程,分别利用隐码的上下文关系与生成隐空间中的多模态语义先验。通过联合优化压缩效率与丢包鲁棒性,该机制在动态丢包条件下仍能提供平稳性能。大量实验表明,在丢包网络下,ResiGLC能在极低带宽成本下有效提升感知保真度与真实感表现。

原文摘要 · Abstract (English)

In extreme-low bandwidth network scenarios, generative semantic codecs have emerged as promising solutions to reduce bandwidth cost for visual communications. However, these learned codecs are usually optimized solely for compression efficiency and thus not robust against transmission errors. Corruptions due to packet-loss among these highly compact generative latent representations often cause more critical degradation in fidelity and realism, intensified by the severe error propagation across the latent contexts and multi-step decoding process. In this paper, we propose ResiGLC, a novel loss-resilient generative latent coding framework designed for robust semantic communication over extreme-low bandwidth packet-loss networks. Motivated by the inherent goal-consistency between generation and compression, we sufficiently exploit the impressive in-context predictive capabilities of language models. Integrated with the masked learning strategy, our model supports arbitrary context modeling of latent codes, which could mitigate the error propagation and handle unpredictable packet loss patterns. At the receiver, a progressive resilient decoding pipeline is presented, which leverages both the contextual relationship of the latent codes and the multi-modal semantic prior in the generative latent space, separately. By jointly optimizing toward both compression efficiency and packet-loss resilience, our proposed progressive decoding mechanism offers graceful performance when dealing with dynamic packet losses. Through extensive experimental evaluations, we establish that under packet-loss network conditions, ResiGLC can effectively improve the loss-resilience in terms of perceptual fidelity and realism qualities with extreme-low bandwidth cost.

语义通信低带宽丢包鲁棒生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。