用收缩理论建立神经网络稳定新准则,实现精确控制与学习
A Nonlinear Separation Principle via Contraction Theory: Applications to Neural Networks, Control, and Learning
- 基于收缩理论构建非线性分离原理,保证控制器与观测器互联全局指数稳定
- 导出RNN的紧致LMI稳定性条件,覆盖脉冲率与霍普菲尔德模型,扩展至图RNN
- 设计低增益积分控制器消除稳态误差,适用于带参考输出追踪的RNN系统
本文基于收缩理论建立非线性分离原理,确保收缩状态反馈控制器与收缩观测器互联时具有全局指数稳定性,并提供参数扩展以增强鲁棒性与平衡点跟踪能力。其次,推导出保证脉冲率神经网络与霍普菲尔德神经网络收缩性的紧致线性矩阵不等式(LMI)条件,揭示各类证书间的结构关系——连续时间模型中单调非减激活函数可最大化允许的权重空间,并将这些稳定性保证扩展至互联系统与图结构RNN。再次,结合分离原理与LMI框架,解决基于RNN建模的被控对象的输出参考追踪问题,提出反馈控制器与观测器的LMI综合方法,并严格设计低增益积分控制器以消除稳态误差。最后,导出收缩型LMI的精确无约束代数参数化形式,用于设计高表达力的隐式神经网络,在标准图像分类基准上达到竞争力的准确率与参数效率。
原文摘要 · Abstract (English)
This paper establishes a nonlinear separation principle based on contraction theory and derives sharp stability conditions for recurrent neural networks (RNNs). First, we introduce a nonlinear separation principle that guarantees global exponential stability for the interconnection of a contracting state-feedback controller and a contracting observer, alongside parametric extensions for robustness and equilibrium tracking. Second, we derive sharp linear matrix inequality (LMI) conditions that guarantee the contractivity of both firing rate and Hopfield neural network architectures. We establish structural relationships among these certificates-demonstrating that continuous-time models with monotone non-decreasing activations maximize the admissible weight space-and extend these stability guarantees to interconnected systems and Graph RNNs. Third, we combine our separation principle and LMI framework to solve the output reference tracking problem for RNN-modeled plants. We provide LMI synthesis methods for feedback controllers and observers, and rigorously design a low-gain integral controller to eliminate steady-state error. Finally, we derive an exact, unconstrained algebraic parameterization of our contraction LMIs to design highly expressive implicit neural networks, achieving competitive accuracy and parameter efficiency on standard image classification benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。