对比多种模型在高光谱图像上的分割表现,为自动驾驶感知提供基准参考。
Hyperspectral Imaging-Based Perception in Autonomous Driving Scenarios: Benchmarking Baseline Semantic Segmentation Models
- 用四种深度学习模型测试高光谱图像语义分割性能。
- UNet-CBAM 模型在各类指标上表现最佳,优于其他模型。
- 适合关注高光谱感知与自动驾驶融合研究的读者。
高光谱成像(HSI)在遥感、农业和医疗领域具有优于传统RGB成像的优势。近年来,其在提升高级驾驶辅助系统(ADAS)感知能力方面受到关注。已有多个高光谱数据集如HyKo、HSI-Drive、HSI-Road和Hyperspectral City发布。然而,针对这些数据集的语义分割模型(SSM)系统评估仍显不足。为此,我们评估了四种基于深度学习的基准分割模型:DeepLab v3+、HRNet、PSPNet和U-Net,及其两个变体——坐标注意力(UNet-CA)和卷积块注意力模块(UNet-CBAM)。原始模型架构被调整以适应不同数据集的空间与光谱维度。各模型在独立数据集上使用类别加权损失函数训练,并通过交并比(IoU)、召回率、精确率、F1分数、特异性及准确率等均值指标进行评估。结果表明,提取通道特征的UNet-CBAM表现最优,展现出利用光谱信息提升分割效果的潜力。本研究建立了现有标注数据集上的语义分割基准,为未来高光谱驱动的ADAS感知评估提供参考。但当前数据集仍存在规模小、类别不平衡严重、细粒度标注缺失等局限,制约了鲁棒性分割模型的发展。
原文摘要 · Abstract (English)
Hyperspectral Imaging (HSI) is known for its advantages over traditional RGB imaging in remote sensing, agriculture, and medicine. Recently, it has gained attention for enhancing Advanced Driving Assistance Systems (ADAS) perception. Several HSI datasets such as HyKo, HSI-Drive, HSI-Road, and Hyperspectral City have been made available. However, a comprehensive evaluation of semantic segmentation models (SSM) using these datasets is lacking. To address this gap, we evaluated the available annotated HSI datasets on four deep learning-based baseline SSMs: DeepLab v3+, HRNet, PSPNet, and U-Net, along with its two variants: Coordinate Attention (UNet-CA) and Convolutional Block-Attention Module (UNet-CBAM). The original model architectures were adapted to handle the varying spatial and spectral dimensions of the datasets. These baseline SSMs were trained using a class-weighted loss function for individual HSI datasets and evaluated using mean-based metrics such as intersection over union (IoU), recall, precision, F1 score, specificity, and accuracy. Our results indicate that UNet-CBAM, which extracts channel-wise features, outperforms other SSMs and shows potential to leverage spectral information for enhanced semantic segmentation. This study establishes a baseline SSM benchmark on available annotated datasets for future evaluation of HSI-based ADAS perception. However, limitations of current HSI datasets, such as limited dataset size, high class imbalance, and lack of fine-grained annotations, remain significant constraints for developing robust SSMs for ADAS applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。