arXiv:2601.22024cs.NIcs.AI2026-01被引 9

让深度强化学习在6G网络中的决策变得可解释,提升可信度与可控性。

SymbXRL: Symbolic Explainable Deep Reinforcement Learning for Mobile Networks

  • 用符号AI生成直观规则和符号描述,揭示DRL决策逻辑。
  • 在真实网络场景中使累积奖励中位数提升12%,优于纯DRL方案。
  • 适合需要可解释性与可控性的6G网络管理场景,如资源调度。

未来6G移动网络的运行将越来越依赖深度强化学习(DRL)在实时环境下优化网络决策。尽管DRL在用户调度、天线分配或计算资源与调制方式联合控制等资源分配问题上表现出色,但其训练后的智能体为黑箱,难以解释,阻碍了其在生产环境中的应用。本文提出SymbXRL,一种新型可解释强化学习(XRL)技术,通过符号人工智能生成人类可理解的解释。SymbXRL利用符号表示关键概念及其关系,结合逻辑推理,暴露DRL智能体的决策过程,提供比现有方法更易懂的行为描述。我们在基于DRL的实际网络管理场景中验证了SymbXRL的有效性,结果表明其不仅提升了解释语义,还实现了显式智能体控制:例如,支持意图驱动的程序化动作引导,在纯DRL基础上使中位数累积奖励提升12%。

原文摘要 · Abstract (English)

The operation of future 6th-generation (6G) mobile networks will increasingly rely on the ability of deep reinforcement learning (DRL) to optimize network decisions in real-time. DRL yields demonstrated efficacy in various resource allocation problems, such as joint decisions on user scheduling and antenna allocation or simultaneous control of computing resources and modulation. However, trained DRL agents are closed-boxes and inherently difficult to explain, which hinders their adoption in production settings. In this paper, we make a step towards removing this critical barrier by presenting SymbXRL, a novel technique for explainable reinforcement learning (XRL) that synthesizes human-interpretable explanations for DRL agents. SymbXRL leverages symbolic AI to produce explanations where key concepts and their relationships are described via intuitive symbols and rules; coupling such a representation with logical reasoning exposes the decision process of DRL agents and offers more comprehensible descriptions of their behaviors compared to existing approaches. We validate SymbXRL in practical network management use cases supported by DRL, proving that it not only improves the semantics of the explanations but also paves the way for explicit agent control: for instance, it enables intent-based programmatic action steering that improves by 12% the median cumulative reward over a pure DRL solution.

可解释AI强化学习6G网络符号推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。