用强化学习统一优化无线控制系统的通信与控制,提升工业自动化效率。
Communication-Control Codesign for Large-Scale Wireless Networked Control Systems
- 构建多回路耦合的无线控制系统模型,考虑信道相关性与资源竞争。
- 基于深度强化学习实现调度与控制联合优化,性能优于传统方法。
- 适合大规模工业控制场景,尤其适用于无人机群、机器人协同等应用。
无线网络化控制系统(WNCS)是工业4.0的关键,支持无人机编队、自主机器人等灵活控制应用。通信与控制的相互依赖要求协同设计,但传统方法常将其分离,导致效率低下。现有协同设计多基于简化模型,局限于单回路或独立多回路系统。而大规模WNCS面临多重挑战:控制回路耦合、时相关无线信道、感测与控制传输间的权衡,以及高计算复杂度。为此,我们提出一种实用的WNCS模型,刻画多个控制回路在空间分布的传感器与执行器间共享有限无线资源时的动态相关性,信道为多状态马尔可夫块衰落。将协同设计问题建模为序列决策任务,联合优化估计、控制与通信域的调度和控制输入。为求解该问题,开发了一种深度强化学习算法,有效处理混合动作空间,捕捉通信-控制相关性,并在跨域变量稀疏、控制输入浮动的条件下保证鲁棒训练。大量仿真表明,所提DRL方法超越基准方案,成功解决大规模WNCS协同设计问题,为工业自动化提供可扩展解决方案。
原文摘要 · Abstract (English)
Wireless Networked Control Systems (WNCSs) are essential to Industry 4.0, enabling flexible control in applications, such as drone swarms and autonomous robots. The interdependence between communication and control requires integrated design, but traditional methods treat them separately, leading to inefficiencies. Current codesign approaches often rely on simplified models, focusing on single-loop or independent multi-loop systems. However, large-scale WNCSs face unique challenges, including coupled control loops, time-correlated wireless channels, trade-offs between sensing and control transmissions, and significant computational complexity. To address these challenges, we propose a practical WNCS model that captures correlated dynamics among multiple control loops with spatially distributed sensors and actuators sharing limited wireless resources over multi-state Markov block-fading channels. We formulate the codesign problem as a sequential decision-making task that jointly optimizes scheduling and control inputs across estimation, control, and communication domains. To solve this problem, we develop a Deep Reinforcement Learning (DRL) algorithm that efficiently handles the hybrid action space, captures communication-control correlations, and ensures robust training despite sparse cross-domain variables and floating control inputs. Extensive simulations show that the proposed DRL approach outperforms benchmarks and solves the large-scale WNCS codesign problem, providing a scalable solution for industrial automation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。