arXiv:2412.15347cs.CVcs.AI2024-12ICML

用无人机采集数据训练模型,实现室内移动物体的实时检测与追踪。

Exploring Machine Learning Engineering for Object Detection and Tracking by Unmanned Aerial Vehicle (UAV)

  • 构建无人机拍摄的室内移动物体数据集,结合人工与自动标注。
  • 在多轮测试中实现96%准确率,平均损失0.1942。
  • 适合做智能感知系统开发或无人机应用的研究者参考。

随着深度学习的发展,自主系统需集成先进机器学习算法以完成多样化任务。本研究聚焦于感知系统中目标检测与追踪子系统的构建与评估。挑战在于数据集创建、标注、特征选择、算法整合与优化,以及性能指标的训练验证。研究提出一种强调可信赖性与自动化提升的机器学习流程。通过采集室内移动物体(如罗巴机器人)视频,模拟搜救场景,提取帧并采用人工与自动相结合的方式标注。初步使用YOLOv4训练数据集以提高标注精度,随后在第二轮训练中分别部署YOLOv4与Mask R-CNN模型,并在Parrot Mambo无人机上实现实时检测与追踪。实验结果表明,模型在多次测试中表现优异,平均损失为0.1942,准确率达96%。

原文摘要 · Abstract (English)

With the advancement of deep learning methods it is imperative that autonomous systems will increasingly become intelligent with the inclusion of advanced machine learning algorithms to execute a variety of autonomous operations. One such task involves the design and evaluation for a subsystem of the perception system for object detection and tracking. The challenge in the creation of software to solve the task is in discovering the need for a dataset, annotation of the dataset, selection of features, integration and refinement of existing algorithms, while evaluating performance metrics through training and testing. This research effort focuses on the development of a machine learning pipeline emphasizing the inclusion of assurance methods with increasing automation. In the process, a new dataset was created by collecting videos of moving object such as Roomba vacuum cleaner, emulating search and rescue (SAR) for indoor environment. Individual frames were extracted from the videos and labeled using a combination of manual and automated techniques. This annotated dataset was refined for accuracy by initially training it on YOLOv4. After the refinement of the dataset it was trained on a second YOLOv4 and a Mask R-CNN model, which is deployed on a Parrot Mambo drone to perform real-time object detection and tracking. Experimental results demonstrate the effectiveness of the models in accurately detecting and tracking the Roomba across multiple trials, achieving an average loss of 0.1942 and 96% accuracy.

目标检测无人机实时追踪数据集构建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。