arXiv:2505.10405eess.IVcs.AI2025-05被引 6

提出新指标与框架,让生成式通信更保真

Visual Fidelity Index for Generative Semantic Communications with Critical Information Embedding

  • 融合文本提示与关键语义特征传输,提升图像生成保真度
  • 新指标GVIF能精准衡量生成图像质量,与PSNR、信息量相关
  • 系统自适应调整特征量,适配不同信道条件,性能更优

基于大模型的生成式语义通信(Gen-SemCom)为6G网络带来变革,通过传输低维提示而非原始数据降低通信开销。但纯提示驱动会丢失细粒度视觉细节,且缺乏系统性评估指标。为此,本文提出一种融合关键信息嵌入(CIE)的混合Gen-SemCom系统:首先采用语义过滤方法提取与语义标签相关的关键图像特征并传输;接收端结合文本提示与关键特征,利用基于扩散模型的生成器重建高保真图像。进一步提出生成式视觉信息保真度(GVIF)指标,通过建模图像特征的统计分布,量化失真特征与其原始版本间的互信息。通过最大化GVIF,设计了信道自适应系统,根据信道状态动态调节特征量与压缩率。实验验证了GVIF对视觉保真度的敏感性,与PSNR和关键信息量高度相关。优化后的系统在PSNR更高、FID更低方面优于基准方案。

原文摘要 · Abstract (English)

Generative semantic communication (Gen-SemCom) with large artificial intelligence (AI) model promises a transformative paradigm for 6G networks, which reduces communication costs by transmitting low-dimensional prompts rather than raw data. However, purely prompt-driven generation loses fine-grained visual details. Additionally, there is a lack of systematic metrics to evaluate the performance of Gen-SemCom systems. To address these issues, we develop a hybrid Gen-SemCom system with a critical information embedding (CIE) framework, where both text prompts and semantically critical features are extracted for transmissions. First, a novel approach of semantic filtering is proposed to select and transmit the semantically critical features of images relevant to semantic label. By integrating the text prompt and critical features, the receiver reconstructs high-fidelity images using a diffusion-based generative model. Next, we propose the generative visual information fidelity (GVIF) metric to evaluate the visual quality of the generated image. By characterizing the statistical models of image features, the GVIF metric quantifies the mutual information between the distorted features and their original counterparts. By maximizing the GVIF metric, we design a channel-adaptive Gen-SemCom system that adaptively control the volume of features and compression rate according to the channel state. Experimental results validate the GVIF metric's sensitivity to visual fidelity, correlating with both the PSNR and critical information volume. In addition, the optimized system achieves superior performance over benchmarking schemes in terms of higher PSNR and lower FID scores.

生成式通信视觉保真度语义编码6G

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。