arXiv:2503.17777eess.IVcs.CV2025-03中稿 · the WCL被引 4

用智能压缩方法融合低分辨率谱图与高分辨率彩图,省带宽还更清晰。

Hierarchy-Aware and Channel-Adaptive Semantic Communication for Bandwidth-Limited Data Fusion

  • 分层相关模块融合多源图像的深层语义与浅层细节
  • 动态注意力机制使传输数据量减少三分之二,PSNR提升2dB
  • 适合带宽受限场景下的高光谱图像重建任务

获取高分辨率高光谱图像(HR-HSI)成本高且数据密集,实际应用中常需将低分辨率高光谱图像(LR-HSI)与高分辨率彩色图像(HR-RGB)融合。传统融合方法在重建时集成大量细节信息,导致带宽消耗显著高于直接传输原始数据。为此,本文提出一种面向带宽受限环境的分层感知与通道自适应语义通信方法。设计分层相关模块以同时保留图像整体结构与超分辨率所需细节,高效融合来自LR-HSI和HR-RGB的深层语义与浅层特征。进一步提出基于Transformer的通道自适应注意力机制,动态整合并传输特征,实现高效传输与高质量重建。在CAVE与Washington DC Mall数据集上的实验表明,本方法优于单源传输,峰值信噪比(PSNR)最高提升2 dB,同时带宽消耗降低三分之二,验证了其在带宽受限环境下重建HR-HSI的有效性。

原文摘要 · Abstract (English)

Obtaining high-resolution hyperspectral images (HR-HSI) is costly and data-intensive, making it necessary to fuse low-resolution hyperspectral images (LR-HSI) with high-resolution RGB images (HR-RGB) for practical applications. However, traditional fusion techniques, which integrate detailed information into the reconstruction, significantly increase bandwidth consumption compared to directly transmitting raw data. To overcome these challenges, we propose a hierarchy-aware and channel-adaptive semantic communication approach for bandwidth-limited data fusion. A hierarchical correlation module is proposed to preserve both the overall structural information and the details of the image required for super-resolution. This module efficiently combines deep semantic and shallow features from LR-HSI and HR-RGB. To further reduce bandwidth usage while preserving reconstruction quality, a channel-adaptive attention mechanism based on Transformer is proposed to dynamically integrate and transmit the deep and shallow features, enabling efficient data transmission and high-quality HR-HSI reconstruction. Experimental results on the CAVE and Washington DC Mall datasets demonstrate that our method outperforms single-source transmission, achieving up to a 2 dB improvement in peak signal-to-noise ratio (PSNR). Additionally, it reduces bandwidth consumption by two-thirds, confirming its effectiveness in bandwidth-constrained environments for HR-HSI reconstruction tasks.

高光谱图像语义通信带宽压缩图像融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。