arXiv:2512.14297cs.NIcs.AI2025-12被引 8

用深度强化学习自动修复工业物联网网络中断,提升恢复速度超五成。

A Threshold-Triggered Deep Q-Network-Based Framework for Self-Healing in Autonomic Software-Defined IIoT-Edge Networks

  • 基于阈值触发的深度Q网络,实时检测并自适应调整路由与资源分配。
  • 相比基线方法恢复效率提升53.84%,优于现有先进算法13.1%~21.5%。
  • 适合对可靠性要求高的风电场等关键工业场景,兼具热管理能力。

软件定义工业网络中,由良性流量突增和交换机热波动引发的随机中断是导致服务间歇性退化的主因。此类事件违反IEC 61850服务质量要求及用户定义的服务水平协议,影响符合IEC 61400-25标准的风电场中控制、监控与尽力而为类流量的可靠及时传输。未能维持这些要求常导致控制信号延迟或丢失、运行效率下降,并增加风力发电机停机风险。为此,本文提出一种阈值触发的深度Q网络自愈代理,可自主检测、分析并缓解网络中断,实时调整路由行为与资源分配。该代理在云基概念验证测试平台上的三簇交换机仿真网络中完成训练、验证与测试。仿真结果表明,相比基线最短路径与负载均衡路由方案,该代理使中断恢复性能提升53.84%;在超脊叶数据平面架构下,优于自适应网络模糊推理系统13.1%、深度Q网络与流量预测结合的路由优化方法21.5%。此外,代理能主动在必要时启动外部机架冷却以维持交换机热稳定。研究凸显了深度强化学习在构建任务关键型、时间敏感型工业网络韧性方面的潜力。

原文摘要 · Abstract (English)

Stochastic disruptions such as flash events arising from benign traffic bursts and switch thermal fluctuations are major contributors to intermittent service degradation in software-defined industrial networks. These events violate IEC~61850-derived quality-of-service requirements and user-defined service-level agreements, hindering the reliable and timely delivery of control, monitoring, and best-effort traffic in IEC~61400-25-compliant wind power plants. Failure to maintain these requirements often results in delayed or lost control signals, reduced operational efficiency, and increased risk of wind turbine generator downtime. To address these challenges, this study proposes a threshold-triggered Deep Q-Network self-healing agent that autonomically detects, analyzes, and mitigates network disruptions while adapting routing behavior and resource allocation in real time. The proposed agent was trained, validated, and tested on an emulated tri-clustered switch network deployed in a cloud-based proof-of-concept testbed. Simulation results show that the proposed agent improves disruption recovery performance by 53.84% compared to a baseline shortest-path and load-balanced routing approach and outperforms state-of-the-art methods, including the Adaptive Network-based Fuzzy Inference System by 13.1% and the Deep Q-Network and traffic prediction-based routing optimization method by 21.5%, in a super-spine leaf data-plane architecture. Additionally, the agent maintains switch thermal stability by proactively initiating external rack cooling when required. These findings highlight the potential of deep reinforcement learning in building resilience in software-defined industrial networks deployed in mission-critical, time-sensitive application scenarios.

自愈网络强化学习工业物联网SDN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。