用深度学习直接估算植物叶片面积,提升育种与生长监测效率。
Deep Learning-Based Direct Leaf Area Estimation using Two RGBD Datasets for Model Development
- 基于RGBD图像和双模型架构,实现叶片分割与面积联合估计。
- 在未见数据上,面积估计的R²达0.81(脱叶)和0.57(植株)。
- 采用敏捷调参策略,适用于真实场景下的作物表型分析。
单叶面积可作为作物生长评估和新品种选育的表型指标,也用于计算叶面积指数和总叶面积。现有研究多采用手持相机、图像处理与3D重建或无监督学习方法估算叶片面积。深度学习在目标检测与分割任务中表现优异,但直接估计物体面积尚未被充分探索。本研究针对真实场景下移动相机采集的RGBD图像,构建了顶视图附生叶数据集和单片脱叶数据集,用于模型开发与测试。首先对人工分割的叶片进行基于图像处理的面积估算;随后改进Mask R-CNN模型以支持RGBD输入并直接输出面积。将脱叶数据与附生叶数据混合训练,提出双主干网络:一个用于分割,另一个用于面积估计。采用敏捷式超参数调优,避免盲目尝试。最终模型通过五折交叉验证,并在两个未见数据集上测试:对于未见脱叶数据,分割F1分数(IoA=90%)为1.0,面积估计的R²为0.81;对于未见植株数据,分割F1分数(IoA=90%)为0.59,面积估计的R²为0.57。研究建议使用带真实面积标注的附生叶数据以进一步提升性能。
原文摘要 · Abstract (English)
Estimation of a single leaf area can be a measure of crop growth and a phenotypic trait to breed new varieties. It has also been used to measure leaf area index and total leaf area. Some studies have used hand-held cameras, image processing 3D reconstruction and unsupervised learning-based methods to estimate the leaf area in plant images. Deep learning works well for object detection and segmentation tasks; however, direct area estimation of objects has not been explored. This work investigates deep learning-based leaf area estimation, for RGBD images taken using a mobile camera setup in real-world scenarios. A dataset for attached leaves captured with a top angle view and a dataset for detached single leaves were collected for model development and testing. First, image processing-based area estimation was tested on manually segmented leaves. Then a Mask R-CNN-based model was investigated, and modified to accept RGBD images and to estimate the leaf area. The detached-leaf data set was then mixed with the attached-leaf plant data set to estimate the single leaf area for plant images, and another network design with two backbones was proposed: one for segmentation and the other for area estimation. Instead of trying all possibilities or random values, an agile approach was used in hyperparameter tuning. The final model was cross-validated with 5-folds and tested with two unseen datasets: detached and attached leaves. The F1 score with 90% IoA for segmentation result on unseen detached-leaf data was 1.0, while R-squared of area estimation was 0.81. For unseen plant data segmentation, the F1 score with 90% IoA was 0.59, while the R-squared score was 0.57. The research suggests using attached leaves with ground truth area to improve the results.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。