arXiv:2411.10178eess.IV2024-11被引 2

用可学习提示让图像传输自适应不同信道,无需重训练

Channel-Adaptive Wireless Image Semantic Transmission with Learnable Prompts

  • 引入可学习信道提示,动态融合信道状态与图像特征
  • 在不同信噪比和信道模型下,PSNR与LPIPS均优于现有方法
  • 轻量高效,适合资源受限设备部署

基于深度学习的联合源信道编码(DeepJSCC)在无线语义通信系统中展现出强大能力。然而,现有方法在不同信道条件下泛化能力差,需为每种信道准备独立模型,仅当测试信道与训练一致时才能达到最优性能,实用性受限。本文提出一种新型DeepJSCC框架——提示联合源信道编码(Prompt JSCC, PJSCC),通过可学习提示模块(Channel State Prompt, CSP)根据不同的信噪比(SNR)和信道分布模型生成提示信号。该提示与图像隐含特征交互,使系统在不重新训练的前提下动态适应变化的信道条件。对比实验表明,PJSCC在多种SNR设置和信道模型下均实现最优图像重建性能,评估指标包括峰值信噪比(PSNR)和基于学习的感知图像块相似性(LPIPS)。此外,该方法在真实场景中表现出优异的内存效率与可扩展性,可直接部署于资源受限平台,支持语义通信应用。

原文摘要 · Abstract (English)

Recent developments in Deep learning based Joint Source-Channel Coding (DeepJSCC) have demonstrated impressive capabilities within wireless semantic communications system. However, existing DeepJSCC methodologies exhibit limited generalization ability across varying channel conditions, necessitating the preparation of multiple models. Optimal performance is only attained when the channel status during testing aligns precisely with the training channel status, which is very inconvenient for real-life applications. In this paper, we introduce a novel DeepJSCC framework, termed Prompt JSCC (PJSCC), which incorporates a learnable prompt to implicitly integrate the physical channel state into the transmission system. Specifically, the Channel State Prompt (CSP) module is devised to generate prompts based on diverse SNR and channel distribution models. Through the interaction of latent image features with channel features derived from the CSP module, the DeepJSCC process dynamically adapts to varying channel conditions without necessitating retraining. Comparative analyses against leading DeepJSCC methodologies and traditional separate coding approaches reveal that the proposed PJSCC achieves optimal image reconstruction performance across different SNR settings and various channel models, as assessed by Peak Signal-to-Noise Ratio (PSNR) and Learning-based Perceptual Image Patch Similarity (LPIPS) metrics. Furthermore, in real-world scenarios, PJSCC shows excellent memory efficiency and scalability, rendering it readily deployable on resource-constrained platforms to facilitate semantic communications.

语义通信深度学习编码自适应传输轻量部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。