arXiv:2507.18160cs.RO2025-07中稿 · and presented on t…被引 5

无人机靠视觉与神经网络实现搜救自动追踪,识人跟人一步到位。

Autonomous UAV Navigation for Search and Rescue Missions Using Computer Vision and Convolutional Neural Networks

  • 用YOLOv11和人体关键点识别定位目标
  • 14人实验中实现实时追踪,保持安全距离
  • 适合救援无人机自主导航开发人员参考

本文提出一种基于无人机(UAV)的搜救子系统,聚焦于人员检测、人脸识别与已识别个体的跟踪。系统采用ROS2框架,集成多个卷积神经网络(CNN)完成搜索任务。通过无人机惯性测量单元(IMU)数据进行系统辨识,设计比例-微分(PD)控制器,利用YOLOv11-pose模型估计无人机相机与目标个体间的距离,实现自主导航。使用YOLOv11和YOLOv11-pose CNN进行目标检测与关键点追踪,dlib库中的CNN用于人脸识别。若目标未知,操作员可手动定位并保存其面部图像,立即启动追踪。在14名已知个体的初步实验中,系统成功实现实时追踪。下一步将在大型实验无人机上部署,并集成GPS引导控制,用于实际救援任务规划。

原文摘要 · Abstract (English)

In this paper, we present a subsystem, using Unmanned Aerial Vehicles (UAV), for search and rescue missions, focusing on people detection, face recognition and tracking of identified individuals. The proposed solution integrates a UAV with ROS2 framework, that utilizes multiple convolutional neural networks (CNN) for search missions. System identification and PD controller deployment are performed for autonomous UAV navigation. The ROS2 environment utilizes the YOLOv11 and YOLOv11-pose CNNs for tracking purposes, and the dlib library CNN for face recognition. The system detects a specific individual, performs face recognition and starts tracking. If the individual is not yet known, the UAV operator can manually locate the person, save their facial image and immediately initiate the tracking process. The tracking process relies on specific keypoints identified on the human body using the YOLOv11-pose CNN model. These keypoints are used to track a specific individual and maintain a safe distance. To enhance accurate tracking, system identification is performed, based on measurement data from the UAVs IMU. The identified system parameters are used to design PD controllers that utilize YOLOv11-pose to estimate the distance between the UAVs camera and the identified individual. The initial experiments, conducted on 14 known individuals, demonstrated that the proposed subsystem can be successfully used in real time. The next step involves implementing the system on a large experimental UAV for field use and integrating autonomous navigation with GPS-guided control for rescue operations planning.

无人机搜救视觉追踪神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。