无人机双相机系统实现远距离精准微检,无需贴身飞行
A Modular Dual-Camera Pipeline for Micro-Inspection Using Aerial Robots

- 双相机协同:变焦镜头远距拍细节,广角镜头定位分区域
- 视觉反馈补偿飞行抖动,确保小区域成像清晰稳定
- 适配树检虫卵与温室捕虫板检测,开源可复用
现有无人机巡检系统常需近距离飞行或复杂路径,易受扰动影响而丢失目标。针对非结构化目标(如树、车、人)缺乏先验几何信息的问题,本文提出aerial_micro_inspection通用巡检流水线。该系统基于PX4无人机平台,配备两个摄像头:(i) 变焦云台相机用于远距离获取精细细节,避免靠近目标;(ii) 广角立体导航相机用于现场获取目标表面图像,估计距离并划分为多个小检测区。同时引入视觉反馈回路,在变焦相机扫描小区域时补偿无人机运动。在仿真与真实实验中验证了其在扰动下的覆盖鲁棒性,并成功实现橡树毛虫及其虫卵的检测和高精度昆虫成像。系统开源,基于ROS 2构建,可通过更换表面分割与微目标检测模型适应新场景。
原文摘要 · Abstract (English)
Most existing drone-based inspection systems require the drone to fly dangerously close to the target or follow complex flight paths to capture small details. In addition, drone flight is affected by disturbances and localization inaccuracies, which can cause the drone to lose sight of its supposed target when it has a narrow view. Furthermore, trajectory planning often requires prior information about the target's geometry, position, and orientation, which is not always available for non-structural targets such as trees, vehicles, or people. To address these challenges, this paper presents aerial_micro_inspection, a generic pipeline for aerial micro-inspection across different use cases. The pipeline assumes a PX4-powered drone equipped with two cameras: (i) a zoomed, gimbal-mounted inspection camera that captures fine details without requiring the drone to fly very close to the target, and (ii) a wide-field-of-view stereo navigation camera that acquires the target surface on site, estimates its range, and partitions it into smaller inspection regions. In addition, a vision-based feedback loop compensates for drone motion while the inspection camera visits small partitions of a larger surface. We evaluate the pipeline in simulation and real-world experiments, mainly in two use-case scenarios: tree inspection for detecting oak processionary caterpillars and their eggs, and greenhouse inspection of sticky traps for detecting whiteflies. The results show improved coverage robustness under drone disturbances in simulation, as well as effective detection of caterpillars and eggs and high-detail imaging of insects in real-world experiments. The pipeline is open-source, developed in ROS 2, and can be adapted to new applications by replacing the surface-segmentation and micro-target detection checkpoints. The code is available at: https://github.com/SaxionMechatronics/aerial_micro_inspection
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。