arXiv:2602.14481cs.ITcs.AI2026-02中稿 · IEEE Internet of T…被引 1

提出率-失真-复杂度三者权衡框架,指导语义通信系统高效设计。

On the Rate-Distortion-Complexity Tradeoff for Semantic Communication

  • 构建融合语义距离与计算复杂度的理论框架
  • 证明高斯与二值源下最小速率的闭式解
  • 验证复杂度度量与实际计算成本强相关,适合资源受限场景

语义通信是一种聚焦于传递用户意图而非比特级信号传输的新型通信范式。其核心挑战在于有效表征和提取任意源信号的语义信息。尽管基于深度学习的方法在从多种源中提取隐含语义信息方面表现优异,但现有工作常忽视编码器与解码器在模型训练和推理中的高计算复杂度。为此,本文提出率-失真-复杂度(RDC)框架,扩展经典率失真理论,引入语义距离约束,包括传统的比特级失真度量和基于统计差异的散度度量,以及来自最小描述长度和信息瓶颈理论的复杂度度量。针对高斯与二值语义源,推导出在给定语义距离与复杂度约束下的最小可实现速率的闭式理论结果。理论分析揭示了可实现速率、语义距离与模型复杂度之间的根本性三方权衡关系。在真实图像与视频数据集上的大量实验验证了该权衡关系,并进一步表明所提信息论复杂度度量能有效关联实际计算开销,为资源受限场景下的系统设计提供指导。

原文摘要 · Abstract (English)

Semantic communication is a novel communication paradigm that focuses on conveying the user's intended meaning rather than the bit-wise transmission of source signals. One of the key challenges is to effectively represent and extract the semantic meaning of any given source signals. While deep learning (DL)-based solutions have shown promising results in extracting implicit semantic information from a wide range of sources, existing work often overlooks the high computational complexity inherent in both model training and inference for the DL-based encoder and decoder. To bridge this gap, this paper proposes a rate-distortion-complexity (RDC) framework which extends the classical rate-distortion theory by incorporating the constraints on semantic distance, including both the traditional bit-wise distortion metric and statistical difference-based divergence metric, and complexity measure, adopted from the theory of minimum description length and information bottleneck. We derive the closed-form theoretical results of the minimum achievable rate under given constraints on semantic distance and complexity for both Gaussian and binary semantic sources. Our theoretical results show a fundamental three-way tradeoff among achievable rate, semantic distance, and model complexity. Extensive experiments on real-world image and video datasets validate this tradeoff and further demonstrate that our information-theoretic complexity measure effectively correlates with practical computational costs, guiding efficient system design in resource-constrained scenarios.

语义通信信息论深度学习复杂度优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。