用优化的Transformer模型让无人机实时识别灾情,省时省力。
UAV-Assisted Real-Time Disaster Detection Using Optimized Transformer Model
- 用后训练量化压缩模型,适配无人机有限算力
- 在新数据集DisasterEye上实现高精度低延迟检测
- 适合灾害应急、无人机巡检等实时场景
危险环境与难以抵达的地形给灾后管理与恢复带来巨大挑战。通过搭载嵌入式平台和光学传感器的无人机(UAV)可有效应对。本文提出一种基于无人机边缘计算的灾情检测框架,实现机载实时图像分类。针对无人机硬件资源受限问题,采用后训练量化技术优化模型。为弥补现有基准数据集灾情样本不足,构建了新数据集DisasterEye,包含无人机与现场人员拍摄的灾情图像。实验表明,该模型在传统设备与资源受限设备上均实现高准确率,同时显著降低推理延迟与内存占用,验证了方法在资源受限无人机平台上的可扩展性与适应性,是实时灾情管理的有效解决方案。
原文摘要 · Abstract (English)
Dangerous surroundings and difficult-to-reach landscapes introduce significant complications for adequate disaster management and recuperation. These problems can be solved by engaging unmanned aerial vehicles (UAVs) provided with embedded platforms and optical sensors. In this work, we focus on enabling onboard aerial image processing to ensure proper and real-time disaster detection. Such a setting usually causes challenges due to the limited hardware resources of UAVs. However, privacy, connectivity, and latency issues can be avoided. We suggest a UAV-assisted edge framework for disaster detection, leveraging our proposed model optimized for onboard real-time aerial image classification. The optimization of the model is achieved using post-training quantization techniques. To address the limited number of disaster cases in existing benchmark datasets and therefore ensure real-world adoption of our model, we construct a novel dataset, DisasterEye, featuring disaster scenes captured by UAVs and individuals on-site. Experimental results reveal the efficacy of our model, reaching high accuracy with lowered inference latency and memory use on both traditional machines and resource-limited devices. This shows that the scalability and adaptability of our method make it a powerful solution for real-time disaster management on resource-constrained UAV platforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。