提出稳定可控的神经反馈控制结构,可自动保证闭环稳定性。
React to Surprises: Stable-by-Design Neural Feedback Control and the Youla-REN
- 基于非线性Youla参数化与递归平衡网络构建控制架构
- 在部分观测和非线性动态下仍保持收缩与Lipschitz稳定性
- 适合学习带稳定证明的控制器,尤其适用于不确定系统
本文研究基于学习的控制中稳定非线性策略的参数化方法。提出一种基于非线性Youla-Kucera参数化的结构,结合鲁棒神经网络(如递归平衡网络REN),该参数化无约束,可使用一阶优化方法搜索,且闭环稳定性由构造保证。研究了非线性动态、部分观测以及增量闭环稳定性要求(收缩性和Lipschitz性)的组合。发现当( c )与( a )或( b )同时成立时,收缩且Lipschitz的Youla参数能保证闭环具有相同性质;但三者共存时,外生扰动可能导致增量稳定性丢失。此时仅能维持较弱条件——d-管收缩与Lipschitz性。进一步获得反向结果:该参数化覆盖特定非线性系统下所有收缩且Lipschitz的闭环。数值实验验证其在学习控制器时的有效性,尤其适用于:(i) 无稳定作用的“经济型”奖励;(ii) 短训练周期;(iii) 不确定系统。
原文摘要 · Abstract (English)
We study parameterizations of stabilizing nonlinear policies for learning-based control. We propose a structure based on a nonlinear version of the Youla-Kucera parameterization combined with robust neural networks such as the recurrent equilibrium network (REN). The resulting parameterizations are unconstrained, and hence can be searched over with first-order optimization methods, while always ensuring closed-loop stability by construction. We study the combination of (a) nonlinear dynamics, (b) partial observation, and (c) incremental closed-loop stability requirements (contraction and Lipschitzness). We find that for the combination of (c) with either (a) or (b), a contracting and Lipschitz Youla parameter always leads to contracting and Lipschitz closed loops. However, if all three hold, then incremental stability can be lost with exogenous disturbances. Instead, a weaker condition is maintained, which we call d-tube contraction and Lipschitzness. We further obtain converse results showing that the proposed parameterization covers all contracting and Lipschitz closed loops for certain classes of nonlinear systems. Numerical experiments illustrate the utility of our parameterization when learning controllers with built-in stability certificates for: (i) ``economic'' rewards without stabilizing effects; (ii) short training horizons; and (iii) uncertain systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。