系统梳理视觉语义通信的分类与技术,为高效传输提供新思路。
A Survey on Semantic Communication for Vision: Categories, Frameworks, Enabling Techniques, and Applications
- 按语义目标将视觉通信分为保语义、扩语义、精语义三类
- 提出基于机器学习的编解码框架与知识利用策略
- 适合研究通信与视觉融合、资源受限场景下的智能传输
语义通信(SemCom)作为视觉数据传输的革新范式,从传输原始数据转向传递有意义的内容,缓解了通信资源压力。然而,实现语义通信面临视觉数据精准语义量化、多样化任务下鲁棒的语义提取与重建、收发端协同及知识有效利用、以及适应不可预测无线环境等挑战。本文对视觉语义通信(SemCom-Vision)进行系统综述,融合计算机视觉与通信工程视角,为机器学习驱动的SemCom-Vision设计提供全面指导。首先阐明语义通信基础概念;其次提出以语义量化方案为依据的新分类方法,将现有方法分为语义保持通信(SPC)、语义扩展通信(SEC)和语义精炼通信(SRC);随后分别阐述各类别的基于机器学习的编码器-解码器模型与训练算法,并分析知识结构与利用策略;最后讨论潜在应用场景。
原文摘要 · Abstract (English)
Semantic communication (SemCom) emerges as a transformative paradigm for traffic-intensive visual data transmission, shifting focus from raw data to meaningful content transmission and relieving the increasing pressure on communication resources. However, to achieve SemCom, challenges are faced in accurate semantic quantization for visual data, robust semantic extraction and reconstruction under diverse tasks and goals, transceiver coordination with effective knowledge utilization, and adaptation to unpredictable wireless communication environments. In this paper, we present a systematic review of SemCom for visual data transmission (SemCom-Vision), wherein an interdisciplinary analysis integrating computer vision (CV) and communication engineering is conducted to provide comprehensive guidelines for the machine learning (ML)-empowered SemCom-Vision design. Specifically, this survey first elucidates the basics and key concepts of SemCom. Then, we introduce a novel classification perspective to categorize existing SemCom-Vision approaches as semantic preservation communication (SPC), semantic expansion communication (SEC), and semantic refinement communication (SRC) based on communication goals interpreted through semantic quantization schemes. Moreover, this survey articulates the ML-based encoder-decoder models and training algorithms for each SemCom-Vision category, followed by knowledge structure and utilization strategies. Finally, we discuss potential SemCom-Vision applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。