风吹下无人机拍摄的植物3D重建,通过迭代补偿运动误差
Iterative Motion Compensation for Canonical 3D Reconstruction from UAV Plant Images Captured in Windy Conditions
- 用光流估计叶片运动,迭代调整图像以对齐动态场景
- 多轮迭代后显著提升现有3D重建方法的精度与细节
- 适合做植物表型分析的研究者,开源代码与数据集可用
植物3D表型分析对理解生长、预测产量和病害控制至关重要。本文提出一种生成高质量单株农业植物3D重建的流程。通过小型商用无人机自主采集图像,仅需在植物上放置ArUco标记,整个成像过程由自研Android应用控制。由于风力和无人机下洗气流影响,重建面临挑战。所提流程可集成任意先进3D重建方法。为缓解图像采集时叶片运动带来的误差,采用迭代变形调整输入图像的方法:基于原始图像与对应视角渲染的中间3D重建之间的光流估计运动,逐步对齐并减少场景运动,最终获得规范化的三维表示。经过数轮迭代,显著提升现有方法的重建效果,实现高分辨率3D网格提取。代码将公开,并提供涵盖多种作物、不同时期的多株植物数据集。
原文摘要 · Abstract (English)
3D phenotyping of plants plays a crucial role for understanding plant growth, yield prediction, and disease control. We present a pipeline capable of generating high-quality 3D reconstructions of individual agricultural plants. To acquire data, a small commercially available UAV captures images of a selected plant. Apart from placing ArUco markers, the entire image acquisition process is fully autonomous, controlled by a self-developed Android application running on the drone's controller. The reconstruction task is particularly challenging due to environmental wind and downwash of the UAV. Our proposed pipeline supports the integration of arbitrary state-of-the-art 3D reconstruction methods. To mitigate errors caused by leaf motion during image capture, we use an iterative method that gradually adjusts the input images through deformation. Motion is estimated using optical flow between the original input images and intermediate 3D reconstructions rendered from the corresponding viewpoints. This alignment gradually reduces scene motion, resulting in a canonical representation. After a few iterations, our pipeline improves the reconstruction of state-of-the-art methods and enables the extraction of high-resolution 3D meshes. We will publicly release the source code of our reconstruction pipeline. Additionally, we provide a dataset consisting of multiple plants from various crops, captured across different points in time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。