用自监督学习减少标签依赖,提升低标签场景下的语义通信性能。
Task-Oriented Low-Label Semantic Communication With Self-Supervised Learning
- 基于无标签数据构建任务相关语义编码器,适应边缘网络真实采集场景。
- 通过对比学习与信息瓶颈优化特征表示,在少量标签下仍保持高推理准确率。
- 适用于无线信道中标签稀缺的智能感知、图像分类等任务,适合边缘设备部署。
面向任务的语义通信通过传输语义信息而非原始消息来提升传输效率。基于深度学习的语义通信可借助大量标注样本训练下游任务,有效提取、传输和理解语义知识。本文提出一种基于自监督学习的语义通信框架(SLSCom),在标注样本有限的场景下增强任务推理性能。具体而言,利用实际边缘网络中设备可获取的无标签样本,设计任务相关的语义编码器;为促进任务相关语义提取,引入自监督学习以学习对比特征,并将信息瓶颈(IB)问题形式化,平衡特征信息量与任务推理性能之间的权衡。针对IB问题的计算挑战,采用自监督分类与重建预训练任务,提出高效联合训练方法,即使在极少标注样本条件下也能实现端到端推理精度的提升。在多径无线信道上的图像分类任务中评估,仿真结果表明,SLSCom显著优于传统数字编码方法及现有深度学习基线方法,无论标注数据集大小或信噪比(SNR)条件如何,即便无标签样本与下游任务无关,仍具优越性。
原文摘要 · Abstract (English)
Task-oriented semantic communication enhances transmission efficiency by conveying semantic information rather than exact messages. Deep learning (DL)-based semantic communication can effectively cultivate the essential semantic knowledge for semantic extraction, transmission, and interpretation by leveraging massive labeled samples for downstream task training. In this paper, we propose a self-supervised learning-based semantic communication framework (SLSCom) to enhance task inference performance, particularly in scenarios with limited access to labeled samples. Specifically, we develop a task-relevant semantic encoder using unlabeled samples, which can be collected by devices in real-world edge networks. To facilitate task-relevant semantic extraction, we introduce self-supervision for learning contrastive features and formulate the information bottleneck (IB) problem to balance the tradeoff between the informativeness of the extracted features and task inference performance. Given the computational challenges of the IB problem, we devise a practical and effective solution by employing self-supervised classification and reconstruction pretext tasks. We further propose efficient joint training methods to enhance end-to-end inference accuracy over wireless channels, even with few labeled samples. We evaluate the proposed framework on image classification tasks over multipath wireless channels. Extensive simulation results demonstrate that SLSCom significantly outperforms conventional digital coding methods and existing DL-based approaches across varying labeled data set sizes and SNR conditions, even when the unlabeled samples are irrelevant to the downstream tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。