arXiv:2605.01869cs.ITcs.CV2026-05

用记忆网络只传语义标记前缀,高效恢复完整信息

Evolving Token Communication with Parametric Memory Network

论文配图:Evolving Token Communication with Parametric Memory Network
图 1 · 摘自论文原文
  • 只传输语义标记前缀,降低通信开销
  • 通过参数化记忆网络重建缺失后缀,实现高精度恢复
  • 支持在线更新,适应信道变化,适合动态通信场景

语义标记通信通过将源数据表示为紧凑的语义标记,成为高效无线传输的有前景框架。然而,传输完整语义标记仍带来显著通信开销。本文提出一种基于参数化记忆网络的演化语义标记通信系统,适用于MIMO衰落信道。具体而言,仅传输每个语义标记等长前缀,降低传输成本并保持接收端可恢复的标记结构。接收端引入参数化记忆网络,从接收到的前缀中重构缺失的后缀信息,语义记忆隐式存储于网络参数中。首先将完整语义标记组织成码本,截断标记与其对应完整标记的码字标签配对。基于这些标记-标签对,构建基于kNN的教师分布,微调预训练的GPT-2恢复模块,使其学习推断每个不完整标记的码字分布并恢复完整语义标记。此外,设计在线演化策略,利用新观测测试样本周期性更新参数化记忆网络与整个系统,提升在分布偏移下的适应能力。实验结果表明,该方法在不同信道条件和带宽比下均优于现有演化记忆基准,最高可提升1.09 dB PSNR。

原文摘要 · Abstract (English)

Token communication has emerged as a promising framework for efficient wireless transmission by representing source data as compact semantic tokens. However, transmitting full semantic tokens still incurs considerable communication overhead. In this paper, we propose an evolving semantic token communication system with a parametric memory network over MIMO fading channels. Specifically, only an equal-length prefix of each semantic token is transmitted, which reduces transmission cost while preserving a consistent token structure for receiver-side recovery. At the receiver, a parametric memory network is introduced to reconstruct the missing suffix information from the received token prefixes, where semantic memory is stored implicitly in the network parameters. To realize this design, full semantic tokens are first organized into a codebook, and truncated tokens are paired with the codeword labels of their corresponding full tokens. Based on these token-label pairs, kNN-based teacher distributions are constructed to fine-tune a pretrained GPT-2-based recovery module, which learns to infer the codeword distribution of each incomplete token and recover the corresponding complete semantic token. In addition, an online evolution strategy is developed to periodically update the parametric memory network and the entire system using newly observed test samples, thereby improving adaptability under distribution shifts. Experimental results demonstrate that the proposed method consistently outperforms the existing evolving memory benchmark under different channel conditions and channel bandwidth ratios, with up to 1.09 dB PSNR improvement.

语义通信记忆网络低开销传输演化系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。