HSI-Drive v2.0扩充四季数据,提升自动驾驶场景理解能力。
HSI-Drive v2.0: More Data for New Challenges in Scene Understanding for Autonomous Driving
- 新增冬秋季真实驾驶视频数据,总图像达752张覆盖四季。
- 基于v2.0训练的模型在道路安全物体识别上性能显著提升。
- 专注轻量高效模型,适配车载实时处理需求。
本文发布超光谱成像(HSI)用于自动驾驶系统(ADS)的HSI-Drive数据集更新版v2.0。v2.0新增冬、秋季真实驾驶场景视频中的标注图像,结合此前v1.1版本的春、夏数据,共包含752张图像,覆盖全年四季。论文展示在v1.1数据集上已有结果的改进,证明基于v2.0训练的模型性能提升。通过引入更强大的图像分割模型,拓展了对车辆、交通标志、行人、骑行者等关键道路安全对象的识别类别,实现更全面的场景理解。同时验证了模型在多种环境与条件下对HSI视频序列的分割表现和鲁棒性。最后强调,评估结果需考虑车载计算平台的实际约束,因此研究聚焦于开发计算高效、轻量化的机器学习模型,以实现高吞吐率运行。数据集及部分分割视频示例可访问 https://ipaccess.ehu.eus/HSI-Drive/。
原文摘要 · Abstract (English)
We present the updated version of the HSI-Drive dataset aimed at developing automated driving systems (ADS) using hyperspectral imaging (HSI). The v2.0 version includes new annotated images from videos recorded during winter and fall in real driving scenarios. Added to the spring and summer images included in the previous v1.1 version, the new dataset contains 752 images covering the four seasons. In this paper, we show the improvements achieved over previously published results obtained on the v1.1 dataset, showcasing the enhanced performance of models trained on the new v2.0 dataset. We also show the progress made in comprehensive scene understanding by experimenting with more capable image segmentation models. These models include new segmentation categories aimed at the identification of essential road safety objects such as the presence of vehicles and road signs, as well as highly vulnerable groups like pedestrians and cyclists. In addition, we provide evidence of the performance and robustness of the models when applied to segmenting HSI video sequences captured in various environments and conditions. Finally, for a correct assessment of the results described in this work, the constraints imposed by the processing platforms that can sensibly be deployed in vehicles for ADS must be taken into account. Thus, and although implementation details are out of the scope of this paper, we focus our research on the development of computationally efficient, lightweight ML models that can eventually operate at high throughput rates. The dataset and some examples of segmented videos are available in https://ipaccess.ehu.eus/HSI-Drive/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。