让图像传输更懂用户意图,精准传递关键信息。
Generalized Query-Oriented Image Semantic Coding Empowered by Large AI Models and Semantic-Aware Hybrid Beamforming

- 根据用户查询提取相关特征,只传重要内容。
- 在未见物体类别上性能超越传统编码与现有先进方案。
- 适合需要高效、智能图像通信的系统设计者。
语义通信是一种新兴范式,可在传输中保留数据的语义。然而,人类用户通常关注特定语义内容,而当前语义编码设计常忽略用户意图。此外,多数现有语义模型依赖特定数据集微调,限制了泛化能力。同时,在大规模多输入多输出正交频分复用(MIMO-OFDM)系统中,如何优先传输语义重要特征仍缺乏研究。为此,本文提出一种通用查询导向图像语义编码(QO-ISC)框架。该框架中,发送端提取与用户查询相关的特征,接收端基于这些特征重建图像。我们采用预训练的大规模人工智能模型(LAM)增强通用特征表示,并设计语义感知混合波束成形(SA-HBF)算法,以在大规模MIMO-OFDM系统中优先处理语义重要特征。在数据集中未见物体类别的评估中,仿真结果表明,所提通用QO-ISC框架性能优于传统编码器及两种先进语义编码方案。
原文摘要 · Abstract (English)
Semantic communication is an emerging paradigm that can preserve the meaning of data during transmission. However, human users are often interested in specific semantic content based on their intent, and users' intent is often not considered in current semantic coding design. Moreover, most of the existing semantic models are fine-tuned using specific datasets, which limits their generalization capability. Furthermore, how to prioritize semantically important features in large-scale multiple-input multiple-output orthogonal frequency-division multiplexing (MIMO-OFDM) systems remains largely unexplored. To address the aforementioned challenges, in this paper, we propose a generalized query-oriented image semantic coding (QO-ISC) framework. In the proposed framework, the transmitter extracts features which are relevant to the user's query and the receiver reconstructs an image based on those features. We use a pretrained large artificial intelligence (AI) model (LAM) to enhance general feature representations. We develop a semantic-aware hybrid beamforming (SA-HBF) algorithm to prioritize semantically important features for large-scale MIMO-OFDM system. When evaluated on unseen object categories within the dataset, simulation results show that our proposed generalized QO-ISC framework achieves better performance than the traditional codec and two state-of-the-art semantic coding schemes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。