用自监督学习压缩图像信息,让通信更高效且适配多种任务
SC-GIR: Goal-oriented Semantic Communication via Invariant Representation Learning
- 通过不变表示学习提取图像关键特征,不依赖具体下游任务
- 在不同信噪比下压缩数据仍保持超85%分类准确率
- 无需标注数据,适合机器间智能通信场景
面向目标的语义通信旨在仅传输任务必需信息以革新通信系统。现有方法存在收发端联合训练导致冗余数据交换、依赖标注数据集等问题,限制了其通用性。为此,本文提出基于不变表示学习的目标导向语义通信框架SC-GIR,用于图像传输。该框架利用自监督学习提取与具体下游任务无关的不变表示,压缩后的表示既高效又保留关键特征,支持后续任务执行。针对机器间任务,采用基于协方差的对比学习获得语义密集的潜在表示。在多个图像数据集上进行有损压缩实验,结果表明SC-GIR相比基线方案性能提升近10%,在不同信噪比条件下压缩数据的分类准确率超过85%。这些结果验证了该框架在学习紧凑且信息丰富潜在表示方面的有效性。
原文摘要 · Abstract (English)
Goal-oriented semantic communication (SC) aims to revolutionize communication systems by transmitting only task-essential information. However, current approaches face challenges such as joint training at transceivers, leading to redundant data exchange and reliance on labeled datasets, which limits their task-agnostic utility. To address these challenges, we propose a novel framework called Goal-oriented Invariant Representation-based SC (SC-GIR) for image transmission. Our framework leverages self-supervised learning to extract an invariant representation that encapsulates crucial information from the source data, independent of the specific downstream task. This compressed representation facilitates efficient communication while retaining key features for successful downstream task execution. Focusing on machine-to-machine tasks, we utilize covariance-based contrastive learning techniques to obtain a latent representation that is both meaningful and semantically dense. To evaluate the effectiveness of the proposed scheme on downstream tasks, we apply it to various image datasets for lossy compression. The compressed representations are then used in a goal-oriented AI task. Extensive experiments on several datasets demonstrate that SC-GIR outperforms baseline schemes by nearly 10%,, and achieves over 85% classification accuracy for compressed data under different SNR conditions. These results underscore the effectiveness of the proposed framework in learning compact and informative latent representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。