用固定相机+旋转植物实现高通量作物三维重建
SC-NeRF: NeRF-based Point Cloud Reconstruction using a Stationary Camera for Agricultural Applications
- 固定相机捕捉旋转植物图像,通过坐标变换模拟移动拍摄
- 重建点云达1000万点,F分数接近100%,精度极佳
- 适合高价值设备如高光谱相机的自动化植物表型分析
本文提出一种基于NeRF的点云重建框架,专为室内高通量作物表型设施设计。传统NeRF方法需相机移动拍摄静止物体,但在高速流水线中不适用。为此,我们采用单个固定相机,配合物体在转盘上旋转,通过COLMAP估计位姿,再经简单坐标变换模拟相机运动,最后进行标准NeRF训练。设定感兴趣区域(ROI)剔除无关场景数据,生成分辨率高达1000万点的点云。实验表明重建保真度优异,所有测试植物对象的精确率-召回率分析F分数均接近100.00。尽管固定相机下位姿估计仍较耗时,但整体训练与重建时间具有竞争力,验证了该方法在实际高通量表型应用中的可行性。结果表明,仅用固定相机即可实现高质量的NeRF三维重建,无需复杂相机运动或昂贵设备,特别适用于高光谱等精密仪器的3D植物表型分析。未来工作将优化位姿估计并简化流程,以无缝集成至自动化高通量三维表型系统。
原文摘要 · Abstract (English)
This paper presents a NeRF-based framework for point cloud (PCD) reconstruction, specifically designed for indoor high-throughput plant phenotyping facilities. Traditional NeRF-based reconstruction methods require cameras to move around stationary objects, but this approach is impractical for high-throughput environments where objects are rapidly imaged while moving on conveyors or rotating pedestals. To address this limitation, we develop a variant of NeRF-based PCD reconstruction that uses a single stationary camera to capture images as the object rotates on a pedestal. Our workflow comprises COLMAP-based pose estimation, a straightforward pose transformation to simulate camera movement, and subsequent standard NeRF training. A defined Region of Interest (ROI) excludes irrelevant scene data, enabling the generation of high-resolution point clouds (10M points). Experimental results demonstrate excellent reconstruction fidelity, with precision-recall analyses yielding an F-score close to 100.00 across all evaluated plant objects. Although pose estimation remains computationally intensive with a stationary camera setup, overall training and reconstruction times are competitive, validating the method's feasibility for practical high-throughput indoor phenotyping applications. Our findings indicate that high-quality NeRF-based 3D reconstructions are achievable using a stationary camera, eliminating the need for complex camera motion or costly imaging equipment. This approach is especially beneficial when employing expensive and delicate instruments, such as hyperspectral cameras, for 3D plant phenotyping. Future work will focus on optimizing pose estimation techniques and further streamlining the methodology to facilitate seamless integration into automated, high-throughput 3D phenotyping pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。