用深度强化学习调控车速,降低越野时的垂直震动。
Stabilization of vertical motion of a vehicle on bumpy terrain using deep reinforcement learning
- 用深度强化学习控制车速来抑制车辆颠簸
- 实测可使垂直加速度降低37%以上
- 适合自动驾驶与军用车辆动态控制场景
在公路和非结构化越野环境中稳定车辆的垂直运动是重要研究课题,传统方法多关注乘坐舒适性。随着自动驾驶的发展,需从车载本体感知与外部传感器实时数据出发设计稳定策略。现有方案通常仅限于主动悬架系统,未充分考虑车速调节的作用——而车辆的垂向与纵向动力学是耦合的。军用车辆在缺乏道路结构的越野场景中面临更大挑战,且车辆质量、悬架刚度与阻尼等参数变化会显著影响控制器性能。因此亟需基于深度学习的控制策略,以处理大量输入特征并逼近近优控制动作。本文通过训练深度强化学习智能体,在模拟越野路况下通过调节车速最小化车辆垂直加速度。
原文摘要 · Abstract (English)
Stabilizing vertical dynamics for on-road and off-road vehicles is an important research area that has been looked at mostly from the point of view of ride comfort. The advent of autonomous vehicles now shifts the focus more towards developing stabilizing techniques from the point of view of onboard proprioceptive and exteroceptive sensors whose real-time measurements influence the performance of an autonomous vehicle. The current solutions to this problem of managing the vertical oscillations usually limit themselves to the realm of active suspension systems without much consideration to modulating the vehicle velocity, which plays an important role by the virtue of the fact that vertical and longitudinal dynamics of a ground vehicle are coupled. The task of stabilizing vertical oscillations for military ground vehicles becomes even more challenging due lack of structured environments, like city roads or highways, in off-road scenarios. Moreover, changes in structural parameters of the vehicle, such as mass (due to changes in vehicle loading), suspension stiffness and damping values can have significant effect on the controller's performance. This demands the need for developing deep learning based control policies, that can take into account an extremely large number of input features and approximate a near optimal control action. In this work, these problems are addressed by training a deep reinforcement learning agent to minimize the vertical acceleration of a scaled vehicle travelling over bumps by controlling its velocity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。