arXiv:2409.12026cs.CVcs.LG2024-09被引 3

ViT在侧扫声呐图像分类中表现优于CNN,但更耗资源。

On Vision Transformers for Classification Tasks in Side-Scan Sonar Imagery

  • 用自注意力机制捕捉全局信息,提升复杂海底场景识别能力。
  • ViT在准确率、召回率等指标上全面超越ResNet和ConvNext。
  • 适合对精度要求高的科研场景,资源受限环境仍推荐CNN。

侧扫声呐(SSS)影像因水下环境复杂多变,在识别海底人工物体时面临挑战。传统方法依赖专家手动解读与手工特征的机器学习,虽深度卷积神经网络(CNN)显著提升了自动化分类能力,但在岩石或波纹沙底等多样纹理背景下,误报率较高。最近,视觉变换器(ViT)凭借自注意力机制捕获图像块的全局信息,展现出更好处理空间层次的灵活性。本文系统比较了ViT与常用CNN架构(如ResNet、ConvNext)在SSS影像二分类任务中的性能。数据集涵盖多种地理海底类型,且正负样本均衡。实验表明,基于ViT的模型在F1分数、精确率、召回率和准确率各项指标上均优于CNN,但计算开销更大。具有归纳偏置的CNN则在计算效率上占优,更适合部署于水下无人平台等资源受限场景。未来研究方向包括探索适用于ViT的自监督学习及多模态融合以进一步提升复杂水下环境下的性能。

原文摘要 · Abstract (English)

Side-scan sonar (SSS) imagery presents unique challenges in the classification of man-made objects on the seafloor due to the complex and varied underwater environments. Historically, experts have manually interpreted SSS images, relying on conventional machine learning techniques with hand-crafted features. While Convolutional Neural Networks (CNNs) significantly advanced automated classification in this domain, they often fall short when dealing with diverse seafloor textures, such as rocky or ripple sand bottoms, where false positive rates may increase. Recently, Vision Transformers (ViTs) have shown potential in addressing these limitations by utilizing a self-attention mechanism to capture global information in image patches, offering more flexibility in processing spatial hierarchies. This paper rigorously compares the performance of ViT models alongside commonly used CNN architectures, such as ResNet and ConvNext, for binary classification tasks in SSS imagery. The dataset encompasses diverse geographical seafloor types and is balanced between the presence and absence of man-made objects. ViT-based models exhibit superior classification performance across f1-score, precision, recall, and accuracy metrics, although at the cost of greater computational resources. CNNs, with their inductive biases, demonstrate better computational efficiency, making them suitable for deployment in resource-constrained environments like underwater vehicles. Future research directions include exploring self-supervised learning for ViTs and multi-modal fusion to further enhance performance in challenging underwater environments.

视觉变换器声呐图像分类任务水下感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。