arXiv:2601.10267cs.LG2026-01被引 2

用上下文解码提升文本传输抗噪能力,不改发送端也能大幅降低误码率。

In-Context Source and Channel Coding

  • 接收端通过可靠性引导的比特翻转生成候选序列
  • 结合大模型算术解码与置信度融合,使低信噪比下误码率降50%以上
  • 适合追求高鲁棒性的通信系统设计者和大模型语义传输研究者

分离式源信道编码(SSCC)因其模块化和兼容现有熵编码器与强纠错码而备受青睐。然而在低信噪比下,信道解码残留的比特错误会灾难性地破坏无损源解码,尤其对基于大语言模型(LLM)的算术编码(AC)影响显著。本文提出一种接收端上下文解码(ICD)框架,在不修改发送端的前提下增强鲁棒性。ICD利用纠错码变换器(ECCT)获取解码信息比特的逐位可靠性,基于上下文一致的比特流,通过可靠性引导的比特翻转构建置信度排序的候选池,采样紧凑且多样的候选子集,并使用基于LLM的算术解码器获得重建结果与序列级对数似然。最终采用可靠性-似然融合规则选择输出。我们进一步提供了采样过程稳定性和收敛性的理论保证。在加性高斯白噪声(AWGN)和瑞利衰落信道上的大量实验表明,该方法相比传统SSCC基线及代表性联合源信道编码(JSCC)方案均取得持续增益。

原文摘要 · Abstract (English)

Separate Source-Channel Coding (SSCC) remains attractive for text transmission due to its modularity and compatibility with mature entropy coders and powerful channel codes. However, SSCC often suffers from a pronounced cliff effect in low Signal-to-Noise Ratio (SNR) regimes, where residual bit errors after channel decoding can catastrophically break lossless source decoding, especially for Arithmetic Coding (AC) driven by Large Language Models (LLMs). This paper proposes a receiver-side In-Context Decoding (ICD) framework that enhances SSCC robustness without modifying the transmitter. ICD leverages an Error Correction Code Transformer (ECCT) to obtain bit-wise reliability for the decoded information bits. Based on the context-consistent bitstream, ICD constructs a confidence-ranked candidate pool via reliability-guided bit flipping, samples a compact yet diverse subset of candidates, and applies an LLM-based arithmetic decoder to obtain both reconstructions and sequence-level log-likelihoods. A reliability-likelihood fusion rule then selects the final output. We further provide theoretical guarantees on the stability and convergence of the proposed sampling procedure. Extensive experiments over Additive White Gaussian Noise (AWGN) and Rayleigh fading channels demonstrate consistent gains compared with conventional SSCC baselines and representative Joint Source-Channel Coding (JSCC) schemes.

信道编码大模型通信鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。