arXiv:2510.04000cs.ITcs.LG2025-10被引 1

只传对任务有用的多模态信息,省带宽还提精度

Distributed Information Bottleneck Theory for Multi-Modal Task-Aware Semantic Communication

  • 用信息瓶颈理论量化各模态对任务的贡献
  • 仅传输最相关模态,通信和计算成本大幅下降
  • 适合资源受限的多模态智能通信场景

语义通信将重点从比特级准确率转向任务相关的语义传递,为下一代网络提供高效智能的通信方式。然而现有多模态方案通常无差别处理所有数据模态,忽略了其对下游任务的贡献不均,导致资源浪费并引入冗余信息,降低任务推理性能。为此,我们提出一种新的任务感知分布式信息瓶颈(TADIB)框架,可量化任意模态组合对特定任务的贡献。基于此理论框架,设计了一种智能编码方案,仅在发送端选择并压缩最任务相关的模态。为实现最优选择与编解码器协同,采用离散选择的概率松弛方法,结合评分函数估计与公共随机性,使分布式编码器能协调决策。在公开数据集上的大量实验表明,该方案在推理质量上达到或超过全模态基线,同时显著降低通信与计算开销。

原文摘要 · Abstract (English)

Semantic communication shifts the focus from bit-level accuracy to task-relevant semantic delivery, enabling efficient and intelligent communication for next-generation networks. However, existing multi-modal solutions often process all available data modalities indiscriminately, ignoring that their contributions to downstream tasks are often unequal. This not only leads to severe resource inefficiency but also degrades task inference performance due to irrelevant or redundant information. To tackle this issue, we propose a novel task-aware distributed information bottleneck (TADIB) framework, which quantifies the contribution of any set of modalities to given tasks. Based on this theoretical framework, we design a practical coding scheme that intelligently selects and compresses only the most task-relevant modalities at the transmitter. To find the optimal selection and the codecs in the network, we adopt the probabilistic relaxation of discrete selection, enabling distributed encoders to make coordinated decisions with score function estimation and common randomness. Extensive experiments on public datasets demonstrate that our solution matches or surpasses the inference quality of full-modal baselines while significantly reducing communication and computational costs.

语义通信多模态信息瓶颈任务感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。