动态信道下自适应采样与语义信道联合编码,提升重建质量并减少数据量。
Adaptive Sampling and Joint Semantic-Channel Coding under Dynamic Channel Environment
- 按图像语义重要性动态调整采样率,生成共享采样分布图。
- 在不同信噪比下保持高质量重建,相比前沿方法降低数据采集量。
- 适合动态信道场景下的智能通信系统设计与研究者参考。
基于深度学习的语义通信受到广泛关注,但多数工作忽略数据获取过程,在动态信道环境下鲁棒性不足。本文提出自适应联合采样-语义-信道编码(Adaptive-JSSCC)框架。针对图像各区域语义重要性,动态优化采样矩阵,生成共享的语义采样比率分布图,指导高保真重建。同时设计注意力式信道自适应模块(ACAM),以信噪比(SNR)为额外输入,融合重组中间特征,缓解训练与测试信道环境不匹配问题。仿真结果表明,所提方法在不降低重建性能的前提下显著减少数据采集量,且对动态信道环境具有高度适应性与可调性。
原文摘要 · Abstract (English)
Deep learning enabled semantic communications are attracting extensive attention. However, most works normally ignore the data acquisition process and suffer from robustness issues under dynamic channel environment. In this paper, we propose an adaptive joint sampling-semantic-channel coding (Adaptive-JSSCC) framework. Specifically, we propose a semantic-aware sampling and reconstruction method to optimize the number of samples dynamically for each region of the images. According to semantic significance, we optimize sampling matrices for each region of the most individually and obtain a semantic sampling ratio distribution map shared with the receiver. Through the guidance of the map, high-quality reconstruction is achieved. Meanwhile, attention-based channel adaptive module (ACAM) is designed to overcome the neural network model mismatch between the training and testing channel environment during sampling-reconstruction and encoding-decoding. To this end, signal-to-noise ratio (SNR) is employed as an extra parameter input to integrate and reorganize intermediate characteristics. Simulation results show that the proposed Adaptive-JSSCC effectively reduces the amount of data acquisition without degrading the reconstruction performance in comparison to the state-of-the-art, and it is highly adaptable and adjustable to dynamic channel environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。