梳理强化学习在无信号交叉口决策中的应用,指出尚无可靠方案。
Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutions
- 结合强化学习与深度学习,学习车辆通过无信号交叉口的行驶策略
- 现有方法在场景建模、假设条件和算法设计上差异大,效果参差不齐
- 适合自动驾驶决策研究者参考,尤其关注真实场景鲁棒性提升
无信号交叉口的自动驾驶仍被视为机器学习的挑战性应用,因其涉及复杂的多智能体场景和高度不确定性。自动化该安全关键环境中的决策过程需理解多层次抽象,以学习鲁棒驾驶行为,实现高效通行。本文综述了当前决策技术,重点分析融合强化学习(RL)与深度学习的算法,用于学习无信号交叉口的通行策略。所评方法在驾驶场景、交叉口模型假设、应对挑战及学习算法上各有不同,我们对比了其优劣。深入分析表明,目前尚无适用于真实世界无信号交叉口的稳健决策方案。基于此,我们提出未来研究方向,鼓励研究者攻克相关挑战。遵循建议,可训练并验证既不过度保守又安全可行的决策架构。
原文摘要 · Abstract (English)
Autonomous driving at unsignalized intersections is still considered a challenging application for machine learning due to the complications associated with handling complex multi-agent scenarios characterized by a high degree of uncertainty. Automating the decision-making process at these safety-critical environments involves comprehending multiple levels of abstractions associated with learning robust driving behaviors to enable the vehicle to navigate efficiently. In this survey, we aim at exploring the state-of-the-art techniques implemented for decision-making applications, with a focus on algorithms that combine Reinforcement Learning (RL) and deep learning for learning traversing policies at unsignalized intersections. The reviewed schemes vary in the proposed driving scenario, in the assumptions made for the used intersection model, in the tackled challenges, and in the learning algorithms that are used. We have presented comparisons for these techniques to highlight their limitations and strengths. Based on our in-depth investigation, it can be discerned that a robust decision-making scheme for navigating real-world unsignalized intersection has yet to be developed. Along with our analysis and discussion, we recommend potential research directions encouraging the interested players to tackle the highlighted challenges. By adhering to our recommendations, decision-making architectures that are both non-overcautious and safe, yet feasible, can be trained and validated in real-world unsignalized intersections environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。