arXiv:2602.20958cs.ROcs.AI2026-02

用深度相机与单目视觉融合,实现无人机对人距离的精准追踪。

EKF-Based Depth Camera and Deep Learning Fusion for UAV-Person Distance Estimation and Following in SAR Operations

  • 结合深度图与单目姿态估计,通过扩展卡尔曼滤波实时融合数据
  • 室内测试中距离误差降低15.3%,在弱光反射下仍保持稳定
  • 适合搜救场景,尤其适用于复杂环境下的无人机动态跟随

基于视觉的无人机系统通过检测、识别特定人员并跟踪其移动,辅助搜救任务。确保无人机安全跟随的关键是准确估计真实环境下摄像头与目标之间的距离,这通过融合多种图像模态实现。本文提出将深度相机测量值与单目相机估算的摄像头到人体距离相结合,用于鲁棒跟踪与跟随。采用YOLO-pose进行深度数据的深度学习滤波及单目相机下人体关键点的距离估计,利用扩展卡尔曼滤波(EKF)算法实现深度信息的实时融合。该子系统专为无人机设计,可估计并测量深度相机与人体关键点之间的距离,以维持无人机与目标间的安全距离。系统在动作捕捉真值数据上验证了高精度距离估计。在实际室内环境中实时测试表明,三种测试场景下平均误差、均方根误差(RMSE)和标准差均下降最多达15.3%。结果表明,基于EKF融合的方法可拓展深度探测范围,有效减少超出最优深度工作区的误差,并在反射和低能见度等挑战性条件下表现出更强的鲁棒性和精度,适用于搜救任务。

原文摘要 · Abstract (English)

Vision-based Unmanned Aerial Vehicles (UAVs) frameworks aid human search tasks by detecting and recognizing specific individuals, then tracking and following them while maintaining a safe distance. A key safety requirement for UAV following is the accurate estimation of the distance between camera and target object under real-world conditions, achieved by fusing multiple image modalities. As part of the system for automatic people detection and face recognition using deep learning, in this paper we present the fusion of depth camera measurements and monocular camera-to-body distance estimation for robust tracking and following. Deep learning based filtering of depth camera data and estimation of camera-to-body distance from a monocular camera are achieved with YOLO-pose, enabling real-time fusion of depth information using the Extended Kalman Filter (EKF) algorithm. The proposed subsystem, designed for use in drones, estimates and measures the distance between the depth camera and the human body keypoints, to maintain the safe distance between the drone and the human target. Our system provides an accurate estimated distance, which has been validated against motion capture ground truth data. The system has been tested in real time indoors, where it reduces the average errors, RMSE and standard deviations of distance estimation up to 15,3% in three tested scenarios. Based on the test results, the EKF fusion-based approach increases the depth detection range by reducing the errors outside the optimal depth camera working range. It also shows improved robustness and precision in challenging conditions, such as reflections and poor visibility, making it suitable for SAR.

无人机追踪深度估计卡尔曼滤波搜救应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。