arXiv:2607.01753cs.CVq-bio.QM2026-07

用3D基础模型让植物三维表型重建从分钟级提速到秒级。

The Turning Point of 3D Plant Phenotyping: 3D Foundation Models Enable Minute-to-Second Cross-Crop Reconstruction and Beyond

论文配图:The Turning Point of 3D Plant Phenotyping: 3D Foundation Models Enable Minute-to-Second Cross-Crop Reconstruction and Beyond
图 1 · 摘自论文原文
  • 用3D基础模型替代传统重建流程,实现端到端几何恢复。
  • 仅需少量视角即可完成高质量重建,平均耗时从6.52分钟降至1.58秒。
  • 适合农业科研与低成像成本场景,支持跨作物快速表型分析。

3D植物表型分析因多视角成像繁琐、重建流程脆弱且后期提取成本高,长期存在效率低下问题,尤其在低成本采集(如手机视频或稀疏视角)时,视图重叠少、自遮挡严重更放大了挑战。本文首次提出基于3D基础模型(3DFM)的跨作物3D表型框架,用3DFM实现前馈式几何恢复,取代传统COLMAP稀疏初始化;结合几何约束的3D高斯溅射完成稠密重建;通过迭代视图合成与优化实现少视角重建;并利用2D到3D语义迁移、尺度恢复和器官实例分离,将重建几何转化为可测量的器官信息。研究构建了基于手机成像、涵盖多样植物形态的跨作物数据集,并附有人工标注的分割与表型评估标签。26个植物序列实验表明,3DFM将平均重建时间从6.52分钟压缩至1.58秒,同时保持高重建质量与表型精度。结果揭示了一条从低成本图像采集到快速重建、感知、尺度恢复与表型测量的全新技术路径。

原文摘要 · Abstract (English)

3D plant phenotyping is notoriously known to be procedure-complicated and of low throughput due to the extensive multi-view imaging, the fragile 3D reconstruction pipeline, and the additional cost from reconstructed geometry to phenotypic extraction. These limitations are further amplified in low-cost data acquisition, where smartphone videos or sparsely sampled multi-view images provide limited view overlap and self-occlusion. In this work, we show that the conventional 3D plant phenotyping pipeline could be streamlined and significantly accelerated with 3D Foundation Models (3DFMs), and particularly, present one of the first cross-crop 3D phenotyping frameworks powered by 3DFMs. The framework replaces COLMAP-style sparse initialization with 3DFM-based feed-forward geometric recovery, combines geometry-constrained 3D Gaussian Splatting for dense reconstruction, enables few-view reconstruction through iterative view synthesis and refinement, and converts reconstructed geometry into measurable organs through 2D-to-3D semantic transfer, metric scale recovery, and organ instance separation. We further construct a cross-crop dataset with smartphone-based image acquisition, diverse plant morphologies, and manual annotations for segmentation and phenotypic evaluation. Experiments across 26 plant sequences show that 3D Foundation Models reduce the average reconstruction time from 6.52 minutes to 1.58 seconds while maintaining high reconstruction quality and phenotyping accuracy. These results suggest a fresh technical route for high-throughput 3D plant phenotyping, from low-cost image acquisition to fast reconstruction, perception, scale recovery, and phenotypic measurement.

3D表型基础模型植物表征高效重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。