arXiv:2606.00561cs.LGcs.AI2026-06

将复杂电网控制模型压缩为可解释的小型决策树,兼顾性能与可读性。

Interpretable Policy Distillation for Power Grid Topology Control

论文配图:Interpretable Policy Distillation for Power Grid Topology Control
图 1 · 摘自论文原文
  • 用压力聚焦数据训练PPO代理,再通过蒸馏生成决策树和随机森林
  • 蒸馏后模型在验证集上平均奖励和存活时长优于原模型,推理成本降低
  • 结果可直接审查,揭示了神经网络与规则代理的表征差异

深度强化学习为电网实时运行提供了可能,但大型神经策略模型评估成本高、部署受限且难以理解。本文研究在保持操作性能的前提下,能否将基于PPO的电网拓扑控制策略压缩为轻量级树形代理。在Grid2Op标准14节点环境中,采用以稳定性为导向的奖励函数,并在高负载关键状态上进行压力聚焦的数据收集来训练PPO教师模型。随后,将该策略蒸馏为决策树和随机森林。在独立验证集上,两种代理均在平均奖励和生存长度上超越原教师模型,且推理开销显著降低。决策树与PPO的argmax动作高度一致,其前几项推荐动作几乎完全匹配;同时模型足够小,可直接人工审查。特征重要性分析显示:PPO主要依赖线路负荷信号,而蒸馏后的树则主要依据母线拓扑变量。结果表明,压力聚焦蒸馏能将黑箱神经控制器转化为轻量、可审计的规则型代理,适用于实时部署,并暴露了确定性动作与拓扑泛化风险。

原文摘要 · Abstract (English)

Deep reinforcement learning (RL) offers a promising route to real-time power grid operation, yet large neural policies are costly to evaluate, hard to deploy on constrained hardware, and opaque to operators. We ask whether a Proximal Policy Optimization (PPO) agent for grid topology control can be compressed into compact tree-based surrogates without losing operational performance. A PPO teacher is trained on Grid2Op's standard 14-bus environment with a stability-oriented reward, using stress-focused data collection on critical, high-loading states. The policy is then distilled into a decision tree and a random forest. Across held-out validation episodes, both surrogates exceed the teacher in mean reward and survival length at a fraction of the inference cost. The decision tree shows high exact-action agreement with the PPO argmax and near-complete agreement within its top-ranked actions, while remaining small enough to be inspected directly. Feature-importance analysis reveals a representational shift: the PPO policy relies mainly on line-loading signals, while the distilled tree is driven primarily by bus-topology variables. These results suggest that stress-focused distillation can convert a black-box neural controller into a lightweight, auditable rule-like surrogate suited for real-time deployment, while also surfacing risks tied to deterministic actions and topology-specific generalization.

电网控制策略蒸馏可解释性决策树

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。