基于视觉重要性的自适应图像无线传输,提升复杂信道下重建质量
Adaptive Wireless Image Semantic Transmission: Design, Simulation, and Prototype Validation
- 用视觉变换器识别图像重要区域,优先保护关键对象
- 实测表明在恶劣信道下重建质量显著提升,峰值信噪比达32.5dB
- 支持真实无线环境测试,适合通信与智能感知融合场景
人工智能的快速发展推动了语义通信的进步,尤其在无线图像传输方面。然而,现有方法难以精确区分并优先处理图像内容,且未充分将语义优先级融入系统设计。本文提出一种自适应无线图像语义传输方案ASCViT-JSCC,采用基于视觉变换器的联合源信道编码(JSCC)。该方案通过目标与特征点检测识别图像区域重要性,对不重要的背景区域进行掩码处理,使其可在接收端恢复,释放出的资源则用于增强关键对象的保护。同时集成量化模块以兼容正交幅度调制(QAM),适配现代无线通信。针对频率选择性衰落信道,引入CSIPA-Net,根据信道信息动态分配功率,进一步提升性能。我们搭建软件定义无线电与嵌入式图形处理单元组成的原型平台,开展空中测试验证方法有效性。仿真与实测结果均表明,ASCViT-JSCC能根据信道条件有效优化对象保护,显著提升图像重建质量,尤其在挑战性信道环境中表现优异。
原文摘要 · Abstract (English)
The rapid development of artificial intelligence has significantly advanced semantic communications, particularly in wireless image transmission. However, most existing approaches struggle to precisely distinguish and prioritize image content, and they do not sufficiently incorporate semantic priorities into system design. In this study, we propose an adaptive wireless image semantic transmission scheme called ASCViT-JSCC, which utilizes vision transformer-based joint source-channel coding (JSCC). This scheme prioritizes different image regions based on their importance, identified through object and feature point detection. Unimportant background sections are masked, enabling them to be recovered at the receiver, while the freed resources are allocated to enhance object protection via the JSCC network. We also integrate quantization modules to enable compatibility with quadrature amplitude modulation, commonly used in modern wireless communications. To address frequency-selective fading channels, we introduce CSIPA-Net, which allocates power based on channel information, further improving performance. Notably, we conduct over-the-air testing on a prototype platform composed of a software-defined radio and embedded graphics processing unit systems, validating our methods. Both simulations and real-world measurements demonstrate that ASCViT-JSCC effectively prioritizes object protection according to channel conditions, significantly enhancing image reconstruction quality, especially in challenging channel environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。