用生成对抗网络提升车载视觉通信效率与图像质量
GAN-Based Semantic Communication for Image Transmission in IoV

- 基于金字塔注意力和语义优先级机制,动态分配传输资源
- 在城市道路数据集上实现更高分割精度和更清晰重建图像
- 适合车联网中带宽受限场景下的高可靠视觉通信
针对车联网协同感知中的视觉数据传输问题,本文提出一种基于生成对抗网络的语义通信框架,以解决传统通信系统在带宽有限和信道动态变化条件下的效率与保真度瓶颈。发送端采用金字塔注意力网络提取语义标签图,并引入基于驾驶安全性的语义优先级保持机制,按类别差异分配比特并设计损失函数。接收端构建了从粗到细的多分辨率生成器与多尺度判别器,结合时序一致性分支、空间金字塔池化及类别感知卷积层,实现对受损语义标签的高质量图像重建。模型通过对抗损失、特征匹配损失与感知损失联合训练,显著提升生成图像的语义一致性和视觉真实感。在Cityscapes数据集上的实验表明,该方法在语义分割准确率和重建图像质量上均优于现有方法,并在加性高斯白噪声(AWGN)与瑞利信道下保持稳定性能。
原文摘要 · Abstract (English)
For cooperative perception in the internet of vehicles, this paper proposes a generative adversarial network-based semantic communication framework to address the efficiency and fidelity bottlenecks of traditional communication systems in visual data transmission under limited bandwidth and dynamic channel conditions. At the transmitter, the framework adopts a pyramid attention network to extract semantic label maps and introduces a semantic priority preservation mechanism. It assigns differentiated weights to distinct semantic categories based on driving safety, guiding bit allocation and loss function design. At the receiver, an image reconstruction module integrating a coarse to-fine multi-resolution generator and multi-scale discriminator is designed. Combined with the temporal consistency branch, spatial pyramid pooling and class-aware convolutional layers, it achieves high-fidelity reconstruction of high-quality images from corrupted semantic labels. The model is trained with combined adversarial, feature matching and perceptual losses, effectively improving semantic consistency and visual realism of generated images. Experimental results on the Cityscapes dataset show that the proposed method outperforms existing counterparts in both semantic segmentation accuracy and reconstructed image quality, and maintains stable reconstruction performance under AWGN and Rayleigh channels.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。