用深度虚构博弈学习无信号交叉口人类驾驶行为,理论保证收敛。
Deep Fictitious Play-Based Potential Differential Games for Learning Human-Like Interaction at Unsignalized Intersections
- 将车辆交互建模为潜在微分博弈,通过数据学习成本权重。
- 在INTERACTION数据集上实现类人驾驶策略,收敛到纳什均衡。
- 适合交通仿真、自动驾驶决策研究者使用。
由于底层博弈过程的复杂性,建模无信号交叉口的车辆交互是一项挑战。尽管先前研究尝试捕捉交互式驾驶行为,但多数方法仅依赖博弈论形式化,未利用自然驾驶数据集。本研究采用深度虚构博弈(Deep Fictitious Play)学习无信号交叉口的人类类驾驶策略。首先将车辆交互建模为微分博弈,并重构为潜在微分博弈;成本函数中的权重从数据中学习,捕获多样化的驾驶风格。我们还证明了该框架在理论上可收敛至纳什均衡。据我们所知,这是首个使用深度虚构博弈训练交互式驾驶策略的研究。基于INTERACTION数据集验证,所提的基于深度虚构博弈的潜在微分博弈(DFP-PDG)框架在学习类人驾驶策略方面表现良好。学习到的个体权重有效捕捉了驾驶员攻击性与偏好的差异。消融实验凸显了模型各组件的重要性。代码已开源:https://github.com/zeonchen/DFP-PDG。
原文摘要 · Abstract (English)
Modeling vehicle interactions at unsignalized intersections is a challenging task due to the complexity of the underlying game-theoretic processes. Although prior studies have attempted to capture interactive driving behaviors, most approaches relied solely on game-theoretic formulations and did not leverage naturalistic driving datasets. In this study, we learn human-like interactive driving policies at unsignalized intersections using Deep Fictitious Play. Specifically, we first model vehicle interactions as a Differential Game, which is then reformulated as a Potential Differential Game. The weights in the cost function are learned from the dataset and capture diverse driving styles. We also demonstrate that our framework provides a theoretical guarantee of convergence to a Nash equilibrium. To the best of our knowledge, this is the first study to train interactive driving policies using Deep Fictitious Play. We validate the effectiveness of our Deep Fictitious Play-Based Potential Differential Game (DFP-PDG) framework using the INTERACTION dataset. The results demonstrate that the proposed framework achieves satisfactory performance in learning human-like driving policies. The learned individual weights effectively capture variations in driver aggressiveness and preferences. Furthermore, the ablation study highlights the importance of each component within our model. Code is available at https://github.com/zeonchen/DFP-PDG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。