arXiv:2507.17893cs.ITcs.AI2025-07被引 3

用强化学习优化二元线性码解码,提升性能同时降低复杂度。

Action-List Reinforcement Learning Syndrome Decoding for Binary Linear Block Codes

  • 将迭代解码建模为马尔可夫决策过程,通过汉明球截断减少状态数。
  • 提出动作列表解码框架,结合深度Q网络显著提升LDPC码性能。
  • 适用于各类码型,可增强现有高性能解码器效果,适合通信系统研究者。

本文探索将强化学习技术应用于基于比特翻转的线性块码解码,以提升解码性能。通过将迭代解码过程映射为马尔可夫决策过程(MDP),提出一种截断式MDP方法,利用指定半径的汉明球来减少状态数量。进一步提出通用的基于强化学习的解码框架——动作列表解码,适用于任意码类,并设计了基于深度Q网络(DQN)的动作列表解码器,显著提升性能。同时利用码的自同构群进一步优化性能。此外,提出一种反馈机制,在已有高性能解码器后应用强化学习算法,以增强性能。这些方法有效降低了强化学习模块的复杂度。最后,通过在二元对称信道(BSC)上的低密度奇偶校验(LDPC)码实验,验证了所提方法的有效性。

原文摘要 · Abstract (English)

This paper explores the application of reinforcement learning techniques to enhance the performance of decoding of linear block codes based on flipping bits and finding optimal decisions. We describe the methodology for mapping the iterative decoding process into Markov Decision Processes (MDPs) and propose different methods to reduce the number of states in the MDP. A truncated MDP is proposed to reduce the number of states in the MDP by learning a Hamming ball with a specified radius around codewords. We then propose a general scheme for reinforcement learning based decoders applicable to any class of codes to improve the performance of decoders. We call this scheme an action-list decoding. We design an action-list decoder based on the Deep-Q network values that substantially enhance performance. We also get benefit of automorphism group of code to further improve the code performance. Additionally, we propose a feedback-based method to exploit and enhance the performance of existing high-performing decoders by applying reinforcement learning algorithms after the existing decoders. These approaches effectively reduces the complexity of the reinforcement learning block. Finally, we present experimental results for the Low-Density Parity Check (LDPC) codes over the Binary Symmetric Channel (BSC) to demonstrate the efficiency of the proposed methods.

强化学习解码优化LDPC码编码理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。