arXiv:2412.08642cs.ITcs.LG2024-12被引 13

用大模型实现语义通信,发端传意不传码,接收端直接生成内容。

Generative Semantic Communication: Architectures, Technologies, and Applications

  • 用大语言模型构建收发两端智能代理,实现语义级内容再生
  • 视频检索场景下通信开销降低99.98%,准确率提升53%
  • 适合高效无线通信、智能内容传输等未来应用场景

本文深入探讨生成式人工智能(GAI)在语义通信(SemCom)中的应用,系统研究三类基于经典GAI模型的SemCom系统:变分自编码器、生成对抗网络和扩散模型。针对每类系统,阐述其核心GAI机制、对应的语义通信架构及近期研究进展。随后提出一种融合前沿GAI技术——大语言模型(LLMs)的新一代生成式语义通信系统。该系统在发送端和接收端分别部署基于LLM的AI智能体,作为‘大脑’实现强大的信息理解与内容再生能力。接收端可直接基于传输的语义信息生成目标内容,无需还原比特流,从而将通信范式从‘信息恢复’转向‘信息再生’,开启生成式语义通信新纪元。通过点对点视频检索案例验证,相比传统通信系统,该方案通信开销减少99.98%,检索准确率提升53%。此外,文中还明确了四种典型应用场景,并讨论了三项待深入研究的开放问题。整体而言,本文为在语义通信中应用GAI提供了全面指导,推动生成式语义通信在未来无线网络中的高效落地。

原文摘要 · Abstract (English)

This paper delves into the applications of generative artificial intelligence (GAI) in semantic communication (SemCom) and presents a thorough study. Three popular SemCom systems enabled by classical GAI models are first introduced, including variational autoencoders, generative adversarial networks, and diffusion models. For each system, the fundamental concept of the GAI model, the corresponding SemCom architecture, and the associated literature review of recent efforts are elucidated. Then, a novel generative SemCom system is proposed by incorporating the cutting-edge GAI technology-large language models (LLMs). This system features two LLM-based AI agents at both the transmitter and receiver, serving as "brains" to enable powerful information understanding and content regeneration capabilities, respectively. This innovative design allows the receiver to directly generate the desired content, instead of recovering the bit stream, based on the coded semantic information conveyed by the transmitter. Therefore, it shifts the communication mindset from "information recovery" to "information regeneration" and thus ushers in a new era of generative SemCom. A case study on point-to-point video retrieval is presented to demonstrate the superiority of the proposed generative SemCom system, showcasing a 99.98% reduction in communication overhead and a 53% improvement in retrieval accuracy compared to the traditional communication system. Furthermore, four typical application scenarios for generative SemCom are delineated, followed by a discussion of three open issues warranting future investigation. In a nutshell, this paper provides a holistic set of guidelines for applying GAI in SemCom, paving the way for the efficient implementation of generative SemCom in future wireless networks.

语义通信生成式AI大模型无线网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。