arXiv:2501.14520eess.SPcs.CV2025-01被引 3

用场景理解+大模型+开放编码,让6G通信更懂意思、更高效。

Scene Understanding Enabled Semantic Communication with Open Channel Coding

  • 结合场景图与大模型,动态生成语义编码。
  • 在VQA任务上提升理解准确率,传输效率更高。
  • 适合需要跨场景自适应的6G智能通信系统。

随着通信系统从符号传输转向有意义信息传递,第六代(6G)网络强调语义通信。该方法聚焦高层语义信息,提升多模态(文本、语音、图像)下的鲁棒性并减少冗余。然而,传统语义通信存在编码策略静态、泛化能力差、依赖特定任务知识库等问题,限制了适应性。为此,我们提出一种结合场景理解、大语言模型(LLMs)与开放信道编码的新系统——OpenSC。传统系统依赖固定领域知识库,难以泛化;而我们的开放编码利用公开共享知识,实现灵活自适应编码。该动态系统降低对静态任务数据的依赖,增强在多样任务与环境中的适应能力。同时,采用场景图进行结构化语义编码,捕捉物体间关系与上下文,提升视觉问答(VQA)等任务表现。本方法选择性编码关键语义元素,减少冗余,提高传输效率。实验表明,在语义理解和传输效率方面均有显著提升,推动6G网络中可适应、可泛化的语义通信发展。

原文摘要 · Abstract (English)

As communication systems transition from symbol transmission to conveying meaningful information, sixth-generation (6G) networks emphasize semantic communication. This approach prioritizes high-level semantic information, improving robustness and reducing redundancy across modalities like text, speech, and images. However, traditional semantic communication faces limitations, including static coding strategies, poor generalization, and reliance on task-specific knowledge bases that hinder adaptability. To overcome these challenges, we propose a novel system combining scene understanding, Large Language Models (LLMs), and open channel coding, named \textbf{OpenSC}. Traditional systems rely on fixed domain-specific knowledge bases, limiting their ability to generalize. Our open channel coding approach leverages shared, publicly available knowledge, enabling flexible, adaptive encoding. This dynamic system reduces reliance on static task-specific data, enhancing adaptability across diverse tasks and environments. Additionally, we use scene graphs for structured semantic encoding, capturing object relationships and context to improve tasks like Visual Question Answering (VQA). Our approach selectively encodes key semantic elements, minimizing redundancy and improving transmission efficiency. Experimental results show significant improvements in both semantic understanding and efficiency, advancing the potential of adaptive, generalizable semantic communication in 6G networks.

语义通信6G大模型场景理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。