arXiv:2508.17746cs.CV2025-08中稿 · IROS 2025被引 2

针对无人机姿态估计难题,提出基于关键点的实时高精度3D姿态检测方法。

DroneKey: Drone 3D Pose Estimation in Image Sequences using Gated Key-representation and Pose-adaptive Learning

  • 用门控融合双关键表示提升2D关键点检测精度
  • 引入自适应马氏距离损失,稳定极端姿态下的预测表现
  • 实现实时44帧/秒处理,适合反无人机系统部署

准确估计无人机3D姿态对反无人机系统至关重要,但现有方法在检测高度相似且姿态多样的螺旋桨关键点时表现不佳。为此,本文提出DroneKey框架,结合2D关键点检测器与专为无人机设计的3D姿态估计算法。在关键点检测阶段,从每个Transformer编码层提取中间与紧凑两种关键表示,并通过门控求和进行最优融合;同时在损失函数中引入姿态自适应马氏距离,提升极端姿态下的预测稳定性。我们构建了新的无人机2D关键点与3D姿态数据集并公开发布。实验表明,该方法在关键点检测上达到99.68%(OKS)的平均精度,显著优于现有方法。消融实验验证了自适应马氏损失的有效性。改进的编码器设计使系统实现44 FPS的实时处理速度。在3D姿态估计方面,平均角度误差为10.62°,均方根误差0.221m,绝对误差平均值0.076m,展现出高精度与可靠性。代码与数据集已开源。

原文摘要 · Abstract (English)

Estimating the 3D pose of a drone is important for anti-drone systems, but existing methods struggle with the unique challenges of drone keypoint detection. Drone propellers serve as keypoints but are difficult to detect due to their high visual similarity and diversity of poses. To address these challenges, we propose DroneKey, a framework that combines a 2D keypoint detector and a 3D pose estimator specifically designed for drones. In the keypoint detection stage, we extract two key-representations (intermediate and compact) from each transformer encoder layer and optimally combine them using a gated sum. We also introduce a pose-adaptive Mahalanobis distance in the loss function to ensure stable keypoint predictions across extreme poses. We built new datasets of drone 2D keypoints and 3D pose to train and evaluate our method, which have been publicly released. Experiments show that our method achieves an AP of 99.68% (OKS) in keypoint detection, outperforming existing methods. Ablation studies confirm that the pose-adaptive Mahalanobis loss function improves keypoint prediction stability and accuracy. Additionally, improvements in the encoder design enable real-time processing at 44 FPS. For 3D pose estimation, our method achieved an MAE-angle of 10.62°, an RMSE of 0.221m, and an MAE-absolute of 0.076m, demonstrating high accuracy and reliability. The code and dataset are available at https://github.com/kkanuseobin/DroneKey.

3D姿态估计无人机检测关键点识别实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。