提出快速初始化神经网络控制器方法,提升视觉伺服控制训练效率与稳定性。
A Fast Initialization Method for Neural Network Controllers: A Case Study of Image-based Visual Servoing Control for the multicopter Interception
- 基于系统模型构建满足稳定性条件的数据集,实现神经网络快速初始化。
- 实验中多旋翼拦截任务达到15米/秒的最终拦截速度。
- 适合需要稳定初始策略的强化学习与李雅普诺夫控制场景。
基于强化学习的控制器设计通常在初始训练阶段需要大量数据,且训练过程随机性强、收敛慢,耗时或需高算力。另一类基于学习的方法结合李雅普诺夫稳定性理论,可提供有保证的控制策略,但通常要求训练初期具备稳定的神经网络控制策略。本文提出的神经网络快速初始化方法,通过基于系统模型构建符合稳定性条件的数据集,实现神经网络控制策略的快速初始训练。以多旋翼视觉伺服拦截任务为例,进行了仿真与实验验证。实验结果表明,训练后的控制策略最终实现15 m/s的拦截速度,有效提升了训练效率与实际性能。
原文摘要 · Abstract (English)
Reinforcement learning-based controller design methods often require substantial data in the initial training phase. Moreover, the training process tends to exhibit strong randomness and slow convergence. It often requires considerable time or high computational resources. Another class of learning-based method incorporates Lyapunov stability theory to obtain a control policy with stability guarantees. However, these methods generally require an initially stable neural network control policy at the beginning of training. Evidently, a stable neural network controller can not only serve as an initial policy for reinforcement learning, allowing the training to focus on improving controller performance, but also act as an initial state for learning-based Lyapunov control methods. Although stable controllers can be designed using traditional control theory, designers still need to have a great deal of control design knowledge to address increasingly complicated control problems. The proposed neural network rapid initialization method in this paper achieves the initial training of the neural network control policy by constructing datasets that conform to the stability conditions based on the system model. Furthermore, using the image-based visual servoing control for multicopter interception as a case study, simulations and experiments were conducted to validate the effectiveness and practical performance of the proposed method. In the experiment, the trained control policy attains a final interception velocity of 15 m/s.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。