多无人机协同拍摄,实时反馈地图优化重建质量
Coverage-Recon: Coordinated Multi-Drone Image Sampling with Online Map Feedback
- 基于二次规划的视角感知控制,确保多角度安全拍摄
- 实时生成3D网格,通过变化反馈动态调整采样重点
- 适合需要高精度三维建模的无人机测绘场景
本文研究多无人机协同3D地图重建问题。高质量重建需从多角度捕捉目标场景的关键点图像,覆盖控制为此提供了有效框架。近年来实时3D重建算法的发展使飞行中可实时渲染动态地图,从而实现即时反馈引导飞行。在此基础上,本文提出Coverage-Recon算法,将在线地图反馈融入协同图像采样,实现重建质量的实时提升。该算法采用基于二次规划(QP)的视角感知覆盖控制器,保障多视角图像采集并满足安全约束。捕获图像由NeuralRecon算法实时处理,生成动态3D网格;场景中网格的变化被解读为重建不确定性,并作为反馈更新覆盖控制的重要性权重。通过仿真与实验验证,结果表明引入在线地图反馈可显著提升重建完整性与准确性,优于传统方法。项目页面:https://htnk-lab.github.io/coverage-recon/
原文摘要 · Abstract (English)
This article addresses collaborative 3D map reconstruction using multiple drones. Achieving high-quality reconstruction requires capturing images of keypoints within the target scene from diverse viewing angles, and coverage control offers an effective framework to meet this requirement. Meanwhile, recent advances in real-time 3D reconstruction algorithms make it possible to render an evolving map during flight, enabling immediate feedback to guide drone motion. Building on this, we present Coverage-Recon, a novel coordinated image sampling algorithm that integrates online map feedback to improve reconstruction quality on-the-fly. In Coverage-Recon, the coordinated motion of drones is governed by a Quadratic Programming (QP)-based angle-aware coverage controller, which ensures multi-viewpoint image capture while enforcing safety constraints. The captured images are processed in real time by the NeuralRecon algorithm to generate an evolving 3D mesh. Mesh changes across the scene are interpreted as indicators of reconstruction uncertainty and serve as feedback to update the importance index of the coverage control as the map evolves. The effectiveness of Coverage-Recon is validated through simulation and experiments, demonstrating both qualitatively and quantitatively that incorporating online map feedback yields more complete and accurate 3D reconstructions than conventional methods. Project page: https://htnk-lab.github.io/coverage-recon/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。