为物联网图像语义通信设计双自适应注意力机制,提升传输鲁棒性。
Doubly Adaptive Channel and Spatial Attention for Semantic Image Communication by IoT Devices
- 在收发端同时引入通道与空间注意力,动态适应信道变化。
- 相比原方法,在多种信噪比下性能显著提升,仅小幅增加复杂度。
- 适合资源受限但对传输质量要求高的物联网场景。
物联网网络面临通信带宽有限、计算与能源资源受限以及无线信道条件高度动态等挑战。结合深度神经网络(DNN)与语义通信的范式成为应对这些限制的有前景方案。近期提出的深度联合源信道编码(DJSCC)可实现图像语义通信。在此基础上,低复杂度的注意力结构被引入以进一步提升性能。然而,为不同信噪比(SNR)分别训练DNN会带来巨大的存储或通信开销,难以由小型物联网设备维持。为此,提出信噪比自适应的DJSCC(ADJSCC),仅需一次训练,将当前SNR作为输入送入通道注意力模块。本文在此基础上,提出双自适应的通道与空间注意力模块,同时部署于发送端与接收端,动态调整以应对信道变化和空间特征重要性,实现鲁棒且高效的特征提取与语义信息恢复。仿真结果表明,所提双自适应DJSCC(DA-DJSCC)在多个性能指标上显著优于ADJSCC,仅带来轻微复杂度增加。这使得DA-DJSCC成为高性能、低复杂度物联网网络中语义通信的理想选择。
原文摘要 · Abstract (English)
Internet of Things (IoT) networks face significant challenges such as limited communication bandwidth, constrained computational and energy resources, and highly dynamic wireless channel conditions. Utilization of deep neural networks (DNNs) combined with semantic communication has emerged as a promising paradigm to address these limitations. Deep joint source-channel coding (DJSCC) has recently been proposed to enable semantic communication of images. Building upon the original DJSCC formulation, low-complexity attention-style architectures has been added to the DNNs for further performance enhancement. As a main hurdle, training these DNNs separately for various signal-to-noise ratios (SNRs) will amount to excessive storage or communication overhead, which can not be maintained by small IoT devices. SNR Adaptive DJSCC (ADJSCC), has been proposed to train the DNNs once but feed the current SNR as part of the data to the channel-wise attention mechanism. We improve upon ADJSCC by a simultaneous utilization of doubly adaptive channel-wise and spatial attention modules at both transmitter and receiver. These modules dynamically adjust to varying channel conditions and spatial feature importance, enabling robust and efficient feature extraction and semantic information recovery. Simulation results corroborate that our proposed doubly adaptive DJSCC (DA-DJSCC) significantly improves upon ADJSCC in several performance criteria, while incurring a mild increase in complexity. These facts render DA-DJSCC a desirable choice for semantic communication in performance demanding but low-complexity IoT networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。