arXiv:2507.08873cs.LGcs.AI2025-07被引 5

用CLIP模型实现无需训练的语义通信,提升无线环境下的传输效率。

Contrastive Language-Image Pre-Training Model based Semantic Communication Performance Optimization

  • 基于CLIP模型实现无训练语义编码,收发端分离操作
  • 联合优化模型与资源块分配,使累积奖励提升4倍
  • 适合低延迟、高能效的智能通信系统应用

本文设计了一种基于对比语言-图像预训练(CLIP)模型的语义通信框架。相较于需要共同数据集联合训练的标准神经网络编码器和解码器,该方法无需任何训练过程,使发送端可直接提取原始数据语义而无需训练,接收端则可在不与发送端通信的情况下训练神经网络完成后续任务。进一步研究了在噪声无线网络中部署该框架的问题。由于CLIP生成的语义信息易受无线噪声影响且频谱资源有限,需联合优化CLIP模型架构与频谱资源块(RB)分配,以在考虑无线噪声、时延和能耗的前提下最大化语义通信性能。为此,采用基于近端策略优化(PPO)的强化学习算法,学习无线噪声对语义通信性能的影响,从而为每个用户找到最优的CLIP模型与资源块配置。仿真结果表明,所提方法相比软演员-批评(SAC)算法,收敛速度提升最高达40%,累积奖励提升达4倍。

原文摘要 · Abstract (English)

In this paper, a novel contrastive language-image pre-training (CLIP) model based semantic communication framework is designed. Compared to standard neural network (e.g.,convolutional neural network) based semantic encoders and decoders that require joint training over a common dataset, our CLIP model based method does not require any training procedures thus enabling a transmitter to extract data meanings of the original data without neural network model training, and the receiver to train a neural network for follow-up task implementation without the communications with the transmitter. Next, we investigate the deployment of the CLIP model based semantic framework over a noisy wireless network. Since the semantic information generated by the CLIP model is susceptible to wireless noise and the spectrum used for semantic information transmission is limited, it is necessary to jointly optimize CLIP model architecture and spectrum resource block (RB) allocation to maximize semantic communication performance while considering wireless noise, the delay and energy used for semantic communication. To achieve this goal, we use a proximal policy optimization (PPO) based reinforcement learning (RL) algorithm to learn how wireless noise affect the semantic communication performance thus finding optimal CLIP model and RB for each user. Simulation results show that our proposed method improves the convergence rate by up to 40%, and the accumulated reward by 4x compared to soft actor-critic.

语义通信CLIP模型强化学习无线传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。