轻量化无人机定位框架,实现实时边缘计算
MobileGeo: Exploring Hierarchical Knowledge Distillation for Resource-Efficient Cross-view Drone Geo-Localization
- 分层知识蒸馏+不确定性感知对齐,训练时压缩模型不增加推理负担
- 多视角筛选模块基于互信息减少冗余,使计算量降低3倍以上
- 在边缘设备上达251.5帧/秒,适用于实时无人机定位场景
跨视图地理定位(CVGL)在无人机多媒体应用中至关重要,可在无GNSS环境下通过匹配无人机拍摄的航拍图像与地理标记的卫星数据库实现精准定位。然而,现有方法依赖高资源消耗的特征对齐和多分支结构,推理开销大,难以部署于边缘设备。本文提出MobileGeo,一种面向移动端的高效CVGL框架:训练阶段采用分层知识蒸馏(HD-CVGL)与不确定性感知预测对齐(UAPA),将关键信息压缩至紧凑模型且不增加推理开销;推理阶段引入高效的多视角选择精炼模块(MSRM),利用互信息过滤冗余视图,显著降低计算负载。大量实验表明,MobileGeo在University1652数据集上比之前最先进方法提升4.19% AP,FLOPs降低超过5倍,速度提升3倍以上,在NVIDIA AGX Orin边缘设备上达到251.5 FPS,验证了其在实时边缘定位中的实用性。代码已开源。
原文摘要 · Abstract (English)
Cross-view geo-localization (CVGL) plays a vital role in drone-based multimedia applications, enabling precise localization by matching drone-captured aerial images against geo-tagged satellite databases in GNSS-denied environments. However, existing methods rely on resource-intensive feature alignment and multi-branch architectures, incurring high inference costs that limit their deployment on edge devices. We propose MobileGeo, a mobile-friendly framework designed for efficient on-device CVGL: 1) During training, a Hierarchical Distillation (HD-CVGL) paradigm, coupled with Uncertainty-Aware Prediction Alignment (UAPA), distills essential information into a compact model without incurring inference overhead. 2) During inference, an efficient Multi-view Selection Refinement Module (MSRM) leverages mutual information to filter redundant views and reduce computational load. Extensive experiments demonstrate that MobileGeo outperforms previous state-of-the-art methods, achieving a 4.19% improvement in AP on University1652 dataset while being over 5 times efficient in FLOPs and 3 times faster. Crucially, MobileGeo runs at 251.5 FPS on an NVIDIA AGX Orin edge device, demonstrating its practical viability for real-time on-device drone geo-localization. The code is available at https://github.com/SkyEyeLoc/MobileGeo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。