解决植物3D分割数据与算法脱节问题,提升自动表型分析能力。
Towards scalable organ level 3D plant segmentation: Bridging the data algorithm computing gap
- 构建开源框架PSS,统一植物点云分割评估标准
- 验证稀疏卷积与基于Transformer的分割方法有效性
- 提出仿真转真实学习策略,减少标注依赖
精确刻画植物形态有助于理解植物与环境互作及遗传演化。3D分割技术可从复杂点云中分离出单个植物器官,但其在植物表型分析中的应用受限于三大挑战:一、大规模标注数据集稀缺;二、先进深度网络难以适配植物点云;三、缺乏面向植物科学的标准基准与评估协议。本文系统性应对上述障碍:一、梳理现有3D植物数据集在通用3D分割领域的分布;二、综述基于深度学习的点云语义与实例分割方法;三、提出开放源代码的Plant Segmentation Studio(PSS)框架,支持可复现基准测试;四、开展广泛定量实验,评估代表性网络与仿真转真实学习策略。结果表明,稀疏卷积主干网络与基于Transformer的实例分割表现优异,且建模与增强生成的合成数据在降低标注需求方面具有互补作用。本研究弥合了算法进展与实际部署之间的差距,为研究者提供即用工具,并指明数据高效、泛化性强的3D植物表型深度学习发展方向。数据与代码见https://github.com/perrydoremi/PlantSegStudio。
原文摘要 · Abstract (English)
The precise characterization of plant morphology provides valuable insights into plant environment interactions and genetic evolution. A key technology for extracting this information is 3D segmentation, which delineates individual plant organs from complex point clouds. Despite significant progress in general 3D computer vision domains, the adoption of 3D segmentation for plant phenotyping remains limited by three major challenges: i) the scarcity of large-scale annotated datasets, ii) technical difficulties in adapting advanced deep neural networks to plant point clouds, and iii) the lack of standardized benchmarks and evaluation protocols tailored to plant science. This review systematically addresses these barriers by: i) providing an overview of existing 3D plant datasets in the context of general 3D segmentation domains, ii) systematically summarizing deep learning-based methods for point cloud semantic and instance segmentation, iii) introducing Plant Segmentation Studio (PSS), an open-source framework for reproducible benchmarking, and iv) conducting extensive quantitative experiments to evaluate representative networks and sim-to-real learning strategies. Our findings highlight the efficacy of sparse convolutional backbones and transformer-based instance segmentation, while also emphasizing the complementary role of modeling-based and augmentation-based synthetic data generation for sim-to-real learning in reducing annotation demands. In general, this study bridges the gap between algorithmic advances and practical deployment, providing immediate tools for researchers and a roadmap for developing data-efficient and generalizable deep learning solutions in 3D plant phenotyping. Data and code are available at https://github.com/perrydoremi/PlantSegStudio.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。