用Transformer加速机器人轨迹优化,实现在低功耗设备上快速求解。
Quattro: Transformer-Accelerated Iterative Linear Quadratic Regulator Framework for Fast Trajectory Optimization
- 用Transformer预测iLQR中间控制矩阵,实现并行计算。
- 在四旋翼系统上单步加速达27倍,整体控制速度提升17.8倍。
- 部署于FPGA,比嵌入式CPU快20.8倍,功耗降低11倍以上。
实时最优控制在机器人领域仍面临根本挑战,尤其对非线性系统且性能要求严苛的场景。作为典型轨迹优化算法,迭代线性二次调节器(iLQR)因固有的串行计算特性,限制了其在实时控制中的效率与应用。现有并行化方案虽试图突破此瓶颈,但通常需额外计算迭代且依赖高性能硬件,实际提升有限。本文提出Quattro,一种基于Transformer加速的iLQR框架,采用软硬件协同设计策略,预测中间反馈与前馈矩阵,实现资源受限设备上的高效并行计算,且不损失精度。在小车-摆杆和四旋翼系统上的实验表明,单次迭代分别加速5.3倍和27倍;集成至模型预测控制(MPC)框架后,整体分别提速2.8倍和17.8倍。将Transformer推理部署于FPGA,相比主流嵌入式CPU最高提速20.8倍,功耗低于GPU超11倍,硬件开销低。
原文摘要 · Abstract (English)
Real-time optimal control remains a fundamental challenge in robotics, especially for nonlinear systems with stringent performance requirements. As one of the representative trajectory optimization algorithms, the iterative Linear Quadratic Regulator (iLQR) faces limitations due to their inherently sequential computational nature, which restricts the efficiency and applicability of real-time control for robotic systems. While existing parallel implementations aim to overcome the above limitations, they typically demand additional computational iterations and high-performance hardware, leading to only modest practical improvements. In this paper, we introduce Quattro, a transformer-accelerated iLQR framework employing an algorithm-hardware co-design strategy to predict intermediate feedback and feedforward matrices. It facilitates effective parallel computations on resource-constrained devices without sacrificing accuracy. Experiments on cart-pole and quadrotor systems show an algorithm-level acceleration of up to 5.3$\times$ and 27$\times$ per iteration, respectively. When integrated into a Model Predictive Control (MPC) framework, Quattro achieves overall speedups of 2.8$\times$ for the cart-pole and 17.8$\times$ for the quadrotor compared to the one that applies traditional iLQR. Transformer inference is deployed on FPGA to maximize performance, achieving further up to 20.8$\times$ speedup over prevalent embedded CPUs with over 11$\times$ power reduction than GPU and low hardware resource overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。