arXiv:2605.21268cs.CV2026-05

对比CNN与ViT在遥感土地利用分类中的表现,指导模型选择。

Vision Transformers and Convolutional Neural Networks for Land Use Scene Classification

  • 用CNN和ViT分别处理遥感图像,比较其性能差异。
  • 小样本时CNN更稳定,大样本下ViT更擅长捕捉全局特征。
  • 适合遥感分类任务的模型选型参考,尤其关注数据量与算力限制。

从遥感影像中进行土地利用场景分类(LUSC)在环境监测、城市规划和可持续资源管理中具有关键作用。近年来,深度学习显著推动了该领域的发展,卷积神经网络(CNN)凭借其强大的局部空间特征提取能力长期占据主导地位。然而,视觉变换器(ViT)通过自注意力机制建模长程依赖,为全局上下文理解提供了新范式。本文对视觉变换器与基于CNN的架构在遥感土地利用场景分类中的表现进行了对比评估。选取代表性CNN模型如AlexNet,与视觉变换器(ViT)在标准遥感数据集UC Merced Land Use和EuroSAT Land Use上进行对比测试,评估指标包括分类准确率、精确率、召回率、F1分数及计算复杂度。实验结果表明:在训练样本有限且局部纹理特征明显的数据集上,CNN表现稳健;而在训练数据充足、场景复杂的场景中,ViT能更好捕捉全局空间关系,取得更优性能。但ViT通常需要更高的计算资源和更大的训练数据量才能发挥优势。研究结果揭示了两类架构的优劣,为遥感土地利用分类应用中的模型选择提供了依据。

原文摘要 · Abstract (English)

Land Use Scene Classification (LUSC) from remote sensing imagery plays a critical role in environmental monitoring, urban planning, and sustainable resource management. In recent years, deep learning methods have significantly advanced the state of the art, with Convolutional Neural Networks (CNNs) dominating the field because of their strong ability to capture local spatial features. However, the emergence of Vision Transformers (ViTs) has introduced a new paradigm that models long-range dependencies through self-attention mechanisms, potentially enabling improved global context understanding. This paper presents a comparative assessment of Vision Transformers and CNN-based architecture for remote sensing land use scene classification. Representative CNN models, such as AlexNet, is evaluated alongside the Vision Transformer (ViT) using benchmark remote sensing datasets, including the UC Merced Land Use and EuroSAT Land Use datasets. The study examines classification accuracy, precision, recall, F1-score, and computational complexity to provide a comprehensive performance comparison. Experimental results demonstrate that CNNs perform robustly on datasets with limited training samples and strong local texture characteristics, whereas Vision Transformers exhibit superior performance in capturing global spatial relationships in complex scenes when sufficient training data are available. However, ViTs typically require greater computational resources and larger training datasets to achieve optimal performance. The findings of this study provide insights into the strengths and limitations of both architectures and offer guidance for selecting appropriate models for remote sensing land use scene classification applications.

遥感分类ViTCNN土地利用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。