用时空注意力提升车道线检测精度与速度,尤其在遮挡和强光下表现更稳。
Efficient Sequential Neural Network with Spatial-Temporal Attention and Linear LSTM for Robust Lane Detection Using Multi-Frame Images
- 引入时空注意力机制,聚焦图像关键区域的车道线特征。
- 在三个数据集上超越现有方法,尤其在遮挡和强光场景中提升显著。
- 模型参数少、计算量低,适合实时自动驾驶系统部署。
车道线检测是自动驾驶车辆(AVs)与高级驾驶辅助系统的关键感知任务,尤其在混合交通环境中,需与人类驾驶车辆(HDVs)及复杂交通场景交互。现有方法难以兼顾准确性、鲁棒性与实时性,视觉方法常忽略图像关键区域及其时空(ST)显著性,导致在严重遮挡和强光条件下性能下降。本文提出一种新型序列神经网络模型,结合时空注意力机制,聚焦车道线关键特征并挖掘连续帧间的显著时空关联。该模型基于标准编码器-解码器结构与通用神经网络骨干网络,在三个大规模开源数据集上训练与评估。大量实验表明,所提模型在多种测试场景中优于当前最优方法。此外,得益于时空注意力机制,模型相比基线序列模型参数更少、乘加操作(MACs)更低,体现良好计算效率。相关数据、代码与模型已公开于 https://doi.org/10.4121/4619cab6-ae4a-40d5-af77-582a77f3d821。
原文摘要 · Abstract (English)
Lane detection is a crucial perception task for all levels of automated vehicles (AVs) and Advanced Driver Assistance Systems, particularly in mixed-traffic environments where AVs must interact with human-driven vehicles (HDVs) and challenging traffic scenarios. Current methods lack versatility in delivering accurate, robust, and real-time compatible lane detection, especially vision-based methods often neglect critical regions of the image and their spatial-temporal (ST) salience, leading to poor performance in difficult circumstances such as serious occlusion and dazzle lighting. This study introduces a novel sequential neural network model with a spatial-temporal attention mechanism to focus on key features of lane lines and exploit salient ST correlations among continuous image frames. The proposed model, built on a standard encoder-decoder structure and common neural network backbones, is trained and evaluated on three large-scale open-source datasets. Extensive experiments demonstrate the strength and robustness of the proposed model, outperforming state-of-the-art methods in various testing scenarios. Furthermore, with the ST attention mechanism, the developed sequential neural network models exhibit fewer parameters and reduced Multiply-Accumulate Operations (MACs) compared to baseline sequential models, highlighting their computational efficiency. Relevant data, code, and models are released at https://doi.org/10.4121/4619cab6-ae4a-40d5-af77-582a77f3d821.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。