用扩散模型按用户意图压缩传输,降低延迟同时保质。
Communicate Less, Synthesize the Rest: Latency-aware Intent-based Generative Semantic Multicasting with Diffusion Models
- 根据用户兴趣只传部分语义,其余由本地扩散模型合成。
- 相比传统方法,单用户延迟显著降低,且感知质量高。
- 适合对延迟敏感的多用户多媒体通信场景。
生成式扩散模型(GDMs)在高感知质量多媒体信号合成方面表现优异,为未来无线网络中的高效语义通信提供了可能。本文提出一种基于预训练扩散模型的意图感知生成式语义多播框架。在该框架中,发射端根据多用户意图将源信号分解为多个语义类别,每个用户仅关注其中部分类别。为更高效利用无线资源,发射端仅向各用户发送其感兴趣的语义类别,并通过共享无线资源向所有用户广播高度压缩的语义图,使用户可本地利用预训练扩散模型合成非感兴趣类别。因此,用户端接收的信号为部分恢复与部分合成的混合结果。我们设计了一种通信/计算感知的逐类自适应机制,动态调整如传输功率、压缩率等通信参数,以最小化多接收端总延迟,适配当前信道条件及用户的重建/合成失真/感知需求。仿真结果表明,相较于非生成式和无意图感知的多播基准方案,本方法显著降低了单用户延迟,同时保持了高质量的信号重建效果。
原文摘要 · Abstract (English)
Generative diffusion models (GDMs) have recently shown great success in synthesizing multimedia signals with high perceptual quality, enabling highly efficient semantic communications in future wireless networks. In this paper, we develop an intent-aware generative semantic multicasting framework utilizing pre-trained diffusion models. In the proposed framework, the transmitter decomposes the source signal into multiple semantic classes based on the multi-user intent, i.e. each user is assumed to be interested in details of only a subset of the semantic classes. To better utilize the wireless resources, the transmitter sends to each user only its intended classes, and multicasts a highly compressed semantic map to all users over shared wireless resources that allows them to locally synthesize the other classes, namely non-intended classes, utilizing pre-trained diffusion models. The signal retrieved at each user is thereby partially reconstructed and partially synthesized utilizing the received semantic map. We design a communication/computation-aware scheme for per-class adaptation of the communication parameters, such as the transmission power and compression rate, to minimize the total latency of retrieving signals at multiple receivers, tailored to the prevailing channel conditions as well as the users' reconstruction/synthesis distortion/perception requirements. The simulation results demonstrate significantly reduced per-user latency compared with non-generative and intent-unaware multicasting benchmarks while maintaining high perceptual quality of the signals retrieved at the users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。