提出融合局部与全局特征的视觉方法,提升自动驾驶路面分类精度。
RoadFormer : Local-Global Feature Fusion for Road Surface Classification in Autonomous Driving

- 通过卷积与注意力模块堆叠,融合局部纹理与全局上下文信息。
- 在百万级数据集上达到92.52%准确率,较现有方法提升超5%。
- 适合需要高精度路面感知的自动驾驶系统研发人员参考。
道路表面分类(RSC)旨在利用路面特征识别路面粗糙度、干湿状态及材料信息,对提升道路安全与交通管理具有重要意义。在自动驾驶中,精准的RSC可帮助车辆理解路况,调整驾驶策略,保障行驶安全与效率。尽管视觉方法长期被青睐,但现有技术忽视了细粒度路面类型(如相似纹理)的区分能力。本文提出一种纯视觉的细粒度RSC方法RoadFormer,通过堆叠卷积与Transformer模块融合局部与全局特征,并探索最优模块堆叠策略。针对细粒度任务中类内差异大、类间差异小的挑战,设计前景-背景模块(FBM),有效提取路面细粒度上下文特征。在包含一百万样本的大规模路面数据集及重构简化数据集上的实验显示,Top-1分类准确率分别达92.52%和96.50%,较当前最优方法提升5.69%至12.84%。结果表明,RoadFormer显著提升了自动驾驶系统中路面感知的可靠性。
原文摘要 · Abstract (English)
The classification of the type of road surface (RSC) aims to utilize pavement features to identify the roughness, wet and dry conditions, and material information of the road surface. Due to its ability to effectively enhance road safety and traffic management, it has received widespread attention in recent years. In autonomous driving, accurate RSC allows vehicles to better understand the road environment, adjust driving strategies, and ensure a safer and more efficient driving experience. For a long time, vision-based RSC has been favored. However, existing visual classification methods have overlooked the exploration of fine-grained classification of pavement types (such as similar pavement textures). In this work, we propose a pure vision-based fine-grained RSC method for autonomous driving scenarios, which fuses local and global feature information through the stacking of convolutional and transformer modules. We further explore the stacking strategies of local and global feature extraction modules to find the optimal feature extraction strategy. In addition, since fine-grained tasks also face the challenge of relatively large intra-class differences and relatively small inter-class differences, we propose a Foreground-Background Module (FBM) that effectively extracts fine-grained context features of the pavement, enhancing the classification ability for complex pavements. Experiments conducted on a large-scale pavement dataset containing one million samples and a simplified dataset reorganized from this dataset achieved Top-1 classification accuracies of 92.52% and 96.50%, respectively, improving by 5.69% to 12.84% compared to SOTA methods. These results demonstrate that RoadFormer outperforms existing methods in RSC tasks, providing significant progress in improving the reliability of pavement perception in autonomous driving systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。