用改进的Transformer模型精准识别南亚洪灾航拍图像,助力救灾决策。
Aerial Flood Scene Classification Using Fine-Tuned Attention-based Architecture for Flood-Prone Countries in South Asia
- 基于微调的紧凑型视觉变压器(CCT)实现高精度分类。
- 模型准确率达98.62%,优于其他Transformer架构。
- 适合南亚地区洪灾监测,对房屋与人员定位有实际应用价值。
南亚国家频繁遭遇严重洪灾。通过图像分类可快速识别洪水区域,包括房屋和人员位置,从而加速搜救行动。本文构建了一个涵盖南亚多国洪灾航拍影像的新数据集。针对分类任务,提出微调的紧凑型卷积注意力网络(CCT)方法,并对比了多种前沿的Transformer与卷积神经网络(CNN)架构。同时,采用YOLOv8模型检测图像中房屋与人员,与分类方法性能进行比较。由于南亚地区地形、建筑结构、洪水颜色及植被相似,本方法具有较强区域适用性。图像分为四类:'洪水'、'含房屋的洪水'、'含人员的洪水'、'无洪水'。在自建数据集上,微调后的CCT模型参数量较少,准确率和宏平均精确率分别达到98.62%和98.50%。其他模型如视觉变压器(ViT)、Swin Transformer、外部注意力网络(EANet)准确率分别为88.66%、84.74%、66.56%。此外,自研集成模型DCECNN(融合MobileNet、InceptionV3、EfficientNetB0)准确率达98.78%。所有模型均针对本数据集进行微调以优化性能。
原文摘要 · Abstract (English)
Countries in South Asia experience many catastrophic flooding events regularly. Through image classification, it is possible to expedite search and rescue initiatives by classifying flood zones, including houses and humans. We create a new dataset collecting aerial imagery of flooding events across South Asian countries. For the classification, we propose a fine-tuned Compact Convolutional Transformer (CCT) based approach and some other cutting-edge transformer-based and Convolutional Neural Network-based architectures (CNN). We also implement the YOLOv8 object detection model and detect houses and humans within the imagery of our proposed dataset, and then compare the performance with our classification-based approach. Since the countries in South Asia have similar topography, housing structure, the color of flood water, and vegetation, this work can be more applicable to such a region as opposed to the rest of the world. The images are divided evenly into four classes: 'flood', 'flood with domicile', 'flood with humans', and 'no flood'. After experimenting with our proposed dataset on our fine-tuned CCT model, which has a comparatively lower number of weight parameters than many other transformer-based architectures designed for computer vision, it exhibits an accuracy and macro average precision of 98.62% and 98.50%. The other transformer-based architectures that we implement are the Vision Transformer (ViT), Swin Transformer, and External Attention Transformer (EANet), which give an accuracy of 88.66%, 84.74%, and 66.56% respectively. We also implement DCECNN (Deep Custom Ensembled Convolutional Neural Network), which is a custom ensemble model that we create by combining MobileNet, InceptionV3, and EfficientNetB0, and we obtain an accuracy of 98.78%. The architectures we implement are fine-tuned to achieve optimal performance on our dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。