用Transformer生成控制序列起点,让强化学习更快更省资源。
Transformer-Based Model Predictive Path Integral Control
- 用训练好的Transformer预测最优控制序列的初始均值
- 在避障和自动驾驶任务中样本效率提升30%,计算速度加快25%
- 适合需要快速响应的机器人控制场景,如自动驾驶
本文提出一种新型方法TransformerMPPI,通过使用Transformer模型基于历史控制数据生成更优的初始控制序列均值,以改进模型预测路径积分(MPPI)控制。传统MPPI因初始轨迹不理想,常面临采样效率低、计算成本高的问题。TransformerMPPI融合了Transformer的注意力机制与采样控制的优势,能捕捉长期控制序列模式,从而从更优起点开始搜索,显著减少所需采样数并加速收敛。我们在二维避障及存在静态与动态障碍物的自主赛车任务中进行评估,数值仿真表明,相较于传统MPPI算法,TransformerMPPI在整体平均代价、采样效率和计算速度上均有持续提升。
原文摘要 · Abstract (English)
This paper presents a novel approach to improve the Model Predictive Path Integral (MPPI) control by using a transformer to initialize the mean control sequence. Traditional MPPI methods often struggle with sample efficiency and computational costs due to suboptimal initial rollouts. We propose TransformerMPPI, which uses a transformer trained on historical control data to generate informed initial mean control sequences. TransformerMPPI combines the strengths of the attention mechanism in transformers and sampling-based control, leading to improved computational performance and sample efficiency. The ability of the transformer to capture long-horizon patterns in optimal control sequences allows TransformerMPPI to start from a more informed control sequence, reducing the number of samples required, and accelerating convergence to optimal control sequence. We evaluate our method on various control tasks, including avoidance of collisions in a 2D environment and autonomous racing in the presence of static and dynamic obstacles. Numerical simulations demonstrate that TransformerMPPI consistently outperforms traditional MPPI algorithms in terms of overall average cost, sample efficiency, and computational speed in the presence of static and dynamic obstacles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。