用自监督学习提升屋顶分类效率,少标签也能高精度。
Efficient Building Roof Type Classification: A Domain-Specific Self-Supervised Approach
- 用EfficientNet加CBAM模块增强特征提取能力
- 在验证集上达95.5%准确率,参数量远低于主流模型
- 领域特定预训练比通用ImageNet更有效,适合数据少场景
从航空影像中精确分类建筑屋顶类型对城市规划、灾害管理和基础设施监测至关重要。然而,监督学习常受限于标注数据稀缺。本文研究基于EfficientNet架构的自监督学习在该任务中的有效性,提出融合卷积块注意力模块(CBAM)的新框架,并比较在领域特定数据集AID与通用ImageNet上预训练的性能差异。实验表明,采用SimCLR方法与EfficientNet-B3+CBAM,在验证集上达到95.5%准确率,媲美先进Transformer模型但参数更少。在两个挑战性测试集上也展现出良好泛化能力。结果强调领域预训练的优势:相较于ImageNet,AID预训练始终带来更高准确率。本工作确立了以EfficientNet为基础的自监督学习是低标注数据环境下屋顶分类的高效解决方案。
原文摘要 · Abstract (English)
Accurate classification of building roof types from aerial imagery is crucial for various remote sensing applications, including urban planning, disaster management, and infrastructure monitoring. However, this task is often hindered by the limited availability of labeled data for supervised learning approaches. To address this challenge, this paper investigates the effectiveness of self supervised learning with EfficientNet architectures, known for their computational efficiency, for building roof type classification. We propose a novel framework that incorporates a Convolutional Block Attention Module (CBAM) to enhance the feature extraction capabilities of EfficientNet. Furthermore, we explore the benefits of pretraining on a domain-specific dataset, the Aerial Image Dataset (AID), compared to ImageNet pretraining. Our experimental results demonstrate the superiority of our approach. Employing Simple Framework for Contrastive Learning of Visual Representations (SimCLR) with EfficientNet-B3 and CBAM achieves a 95.5% accuracy on our validation set, matching the performance of state-of-the-art transformer-based models while utilizing significantly fewer parameters. We also provide a comprehensive evaluation on two challenging test sets, demonstrating the generalization capability of our method. Notably, our findings highlight the effectiveness of domain-specific pretraining, consistently leading to higher accuracy compared to models pretrained on the generic ImageNet dataset. Our work establishes EfficientNet based self-supervised learning as a computationally efficient and highly effective approach for building roof type classification, particularly beneficial in scenarios with limited labeled data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。