通过实车测试对比多种神经网络,优化端到端自动驾驶的实时性与稳定性。
Imitation Learning for Autonomous Driving: Insights from Real-World Testing
- 采用渐进式设计,逐步提升模型容量与数据集应对复杂路况。
- CNN-LSTM与CNN-NODE实现平滑驾驶,优于基础PD与纯CNN模型。
- 适合关注自动驾驶实车验证与模型迭代的开发者与研究者。
本研究聚焦于基于深度学习的自动驾驶系统设计,并在真实世界MIT Racecar平台上进行测试,评估其在实际驾驶场景中的有效性。深度神经网络(DNN)以端到端学习方式,将原始图像输入转化为实时转向指令。关键设计挑战在于确保DNN预测准确且响应迅速,在高采样频率下实现不同工况下的平稳车辆运行。本文设计并比较了多种DNN结构:PD系统、CNN、CNN-LSTM和CNN-NODE,均在真实世界的MIT Racecar上进行评估。PD系统仅能处理基本车道保持,但在急弯和光照变化下表现不佳;CNN虽提升了转向精度,但缺乏时间感知能力;CNN-LSTM通过引入时序建模实现了平顺驾驶;CNN-NODE在处理驾驶动态方面与CNN-LSTM相当,且驾驶表现略优。研究结果强调了迭代式设计对构建鲁棒自动驾驶DNN的重要性。实验视频见https://www.youtube.com/watch?v=FNNYgU--iaY。
原文摘要 · Abstract (English)
This work focuses on the design of a deep learning-based autonomous driving system deployed and tested on the real-world MIT Racecar to assess its effectiveness in driving scenarios. The Deep Neural Network (DNN) translates raw image inputs into real-time steering commands in an end-to-end learning fashion, following the imitation learning framework. The key design challenge is to ensure that DNN predictions are accurate and fast enough, at a high sampling frequency, and result in smooth vehicle operation under different operating conditions. In this study, we design and compare various DNNs, to identify the most effective approach for real-time autonomous driving. In designing the DNNs, we adopted an incremental design approach that involved enhancing the model capacity and dataset to address the challenges of real-world driving scenarios. We designed a PD system, CNN, CNN-LSTM, and CNN-NODE, and evaluated their performance on the real-world MIT Racecar. While the PD system handled basic lane following, it struggled with sharp turns and lighting variations. The CNN improved steering but lacked temporal awareness, which the CNN-LSTM addressed as it resulted in smooth driving performance. The CNN-NODE performed similarly to the CNN-LSTM in handling driving dynamics, yet with slightly better driving performance. The findings of this research highlight the importance of iterative design processes in developing robust DNNs for autonomous driving applications. The experimental video is available at https://www.youtube.com/watch?v=FNNYgU--iaY.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。