让自动驾驶赛车实时博弈超车,逼近最优策略。
α-RACER: Real-Time Algorithm for Game-Theoretic Motion Planning and Control in Autonomous Racing using Near-Potential Function
- 用近势函数建模竞速中的超车与阻挡行为。
- 在线实时计算纳什均衡,3辆车对战表现更优。
- 适合需要实时多车博弈的自动驾驶场景研究。
自动驾驶赛车不仅需在物理极限下控制车辆,还需运用策略性动作击败对手。现有控制算法虽能在单车场景下实现人类水平的离线路线规划,但针对多车实时博弈的算法仍较匮乏。为此,本文提出一种博弈论建模框架,通过新颖的策略参数化方式,将超车、阻挡等竞争行为融入其中,并使车辆持续运行于物理极限。进一步提出基于动态近势函数的算法,实现纳什均衡(近似)的实时求解。方法分为离线与在线两阶段:离线阶段利用仿真数据学习近势函数,以近似代理人的效用变化;在线阶段则通过最大化该函数值来快速计算近似纳什均衡。在3车头对头竞速场景中评估表明,本方法性能显著优于多个现有基线。
原文摘要 · Abstract (English)
Autonomous racing extends beyond the challenge of controlling a racecar at its physical limits. Professional racers employ strategic maneuvers to outwit other competing opponents to secure victory. While modern control algorithms can achieve human-level performance by computing offline racing lines for single-car scenarios, research on real-time algorithms for multi-car autonomous racing is limited. To bridge this gap, we develop game-theoretic modeling framework that incorporates the competitive aspect of autonomous racing like overtaking and blocking through a novel policy parametrization, while operating the car at its limit. Furthermore, we propose an algorithmic approach to compute the (approximate) Nash equilibrium strategy, which represents the optimal approach in the presence of competing agents. Specifically, we introduce an algorithm inspired by recently introduced framework of dynamic near-potential function, enabling real-time computation of the Nash equilibrium. Our approach comprises two phases: offline and online. During the offline phase, we use simulated racing data to learn a near-potential function that approximates utility changes for agents. This function facilitates the online computation of approximate Nash equilibria by maximizing its value. We evaluate our method in a head-to-head 3-car racing scenario, demonstrating superior performance compared to several existing baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。