用AI模型统一解码6G各类编码,无需为每种码重新训练。
Cross-Attention Message-Passing Transformers for Code-Agnostic Decoding in 6G Networks
- 设计跨注意力消息传递变压器,迭代更新幅度与校验向量以学习解码。
- 单模型实现多种码型解码,短码性能显著提升,优于现有神经解码器。
- 适合6G系统中需要灵活、通用解码的场景,如异构通信需求。
6G网络的信道编码需应对多样化的通信场景需求,传统专用解码器缺乏灵活性与可扩展性。为此,我们提出基于Transformer架构的AI原生基础解码模型。首先引入交叉注意力消息传递变压器(CrossMPT),通过两个掩码交叉注意力模块迭代更新幅度向量和校验向量,有效学习解码问题;其在单神经解码器中达到当前最优性能。在此基础上,构建对码长、码率、码类不变的基座模型FCrossMPT,单一模型可解码多种码型而无需重训。为进一步提升短块长码性能,提出由多个并行CrossMPT模块组成的集成解码器CrossED,各模块使用不同校验矩阵,兼具强泛化能力。整体方案在灵活性、可扩展性与高性能间取得平衡,为6G信道编码提供新方向。
原文摘要 · Abstract (English)
Channel coding for 6G networks is expected to support a wide range of requirements arising from heterogeneous communication scenarios. These demands challenge traditional code-specific decoders, which lack the flexibility and scalability required for next-generation systems. To tackle this problem, we propose an AI-native foundation model for unified and code-agnostic decoding based on the transformer architecture. We first introduce a cross-attention message-passing transformer (CrossMPT). CrossMPT employs two masked cross-attention blocks that iteratively update two distinct input representations-magnitude and syndrome vectors-allowing the model to effectively learn the decoding problem. Notably, our CrossMPT has achieved state-of-the-art decoding performance among single neural decoders. Building on this, we develop foundation CrossMPT (FCrossMPT) by making the architecture invariant to code length, rate, and class, allowing a single trained model to decode a broad range of codes without retraining. To further enhance decoding performance, particularly for short blocklength codes, we propose CrossMPT ensemble decoder (CrossED), an ensemble decoder composed of multiple parallel CrossMPT blocks employing different parity-check matrices. This architecture can also serve as a foundation model, showing strong generalization across diverse code types. Overall, the proposed AI-native code-agnostic decoder offers flexibility, scalability, and high performance, presenting a promising direction to channel coding for 6G networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。