arXiv:2512.11705cs.LGcs.SY2025-12

用神经网络代理模型优化高维控制器参数,提升闭环控制性能

High-Dimensional Surrogate Modeling for Closed-Loop Learning of Neural-Network-Parameterized Model Predictive Control

  • 用贝叶斯神经网络做代理模型,捕捉高维控制器参数空间结构
  • 在200维以上参数下仍实现快速收敛,优于传统高斯过程
  • 适合大规模模型预测控制的参数调优,尤其适用于千维级参数

从闭环数据中学习控制器参数可提升系统性能。贝叶斯优化作为高效的黑箱学习方法,通过少量实验构建闭环性能的概率代理模型,并据此选择有信息量的控制器参数。然而,面对高维控制器参数化(如模型预测控制中的调参)时,标准代理模型难以捕捉其结构,导致性能下降。本文提出使用贝叶斯神经网络作为代理模型以缓解此问题。在小车-摆杆任务中,对比了具有Matern核的高斯过程、有限宽度和无限宽度的贝叶斯神经网络,结果表明:贝叶斯神经网络在数百维参数空间中实现更快更稳定的闭环代价收敛;无限宽度贝叶斯神经网络在超过一千维参数时仍保持有效,而Matern核高斯过程则迅速失效。这表明贝叶斯神经网络代理模型适用于学习密集高维控制器参数,为基于学习的控制器设计提供实际建模选择指导。

原文摘要 · Abstract (English)

Learning controller parameters from closed-loop data has been shown to improve closed-loop performance. Bayesian optimization, a widely used black-box and sample-efficient learning method, constructs a probabilistic surrogate of the closed-loop performance from few experiments and uses it to select informative controller parameters. However, it typically struggles with dense high-dimensional controller parameterizations, as they may appear, for example, in tuning model predictive controllers, because standard surrogate models fail to capture the structure of such spaces. This work suggests that the use of Bayesian neural networks as surrogate models may help to mitigate this limitation. Through a comparison between Gaussian processes with Matern kernels, finite-width Bayesian neural networks, and infinite-width Bayesian neural networks on a cart-pole task, we find that Bayesian neural network surrogate models achieve faster and more reliable convergence of the closed-loop cost and enable successful optimization of parameterizations with hundreds of dimensions. Infinite-width Bayesian neural networks also maintain performance in settings with more than one thousand parameters, whereas Matern-kernel Gaussian processes rapidly lose effectiveness. These results indicate that Bayesian neural network surrogate models may be suitable for learning dense high-dimensional controller parameterizations and offer practical guidance for selecting surrogate models in learning-based controller design.

控制器优化贝叶斯优化高维参数神经网络代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。