用零样本模型自动识别玉米棒上每行籽粒数,提升育种数据采集效率。
MaizeEar-SAM: Zero-Shot Maize Ear Phenotyping
- 基于SAM模型实现无需标注的玉米籽粒分割
- 成功在多种玉米穗上准确计算每行籽粒数
- 适合农业科研与育种机构快速部署
玉米(Zea mays L.)产量构成性状的量化对植物遗传学研究、育种及农业实践至关重要。单位面积产量由每亩株数、每株穗数、每穗籽粒数和单粒重决定,其中每穗籽粒数等于每穗行数乘以每行籽粒数。传统人工测量耗时长,难以大规模应用;现有图像处理与深度学习方法面临标注成本高、泛化能力差的问题。本文探索使用开源大视觉模型Segment Anything Model(SAM)实现零样本、免标注的玉米籽粒分割,并结合图算法计算每行籽粒数。该方法在多种玉米穗图像上均有效识别每行籽粒数,展示了基础视觉模型与图像处理技术结合在农艺表型自动化中的潜力,可降低主观性并提升效率。所有代码已开源,推动低成本表型技术普及。
原文摘要 · Abstract (English)
Quantifying the variation in yield component traits of maize (Zea mays L.), which together determine the overall productivity of this globally important crop, plays a critical role in plant genetics research, plant breeding, and the development of improved farming practices. Grain yield per acre is calculated by multiplying the number of plants per acre, ears per plant, number of kernels per ear, and the average kernel weight. The number of kernels per ear is determined by the number of kernel rows per ear multiplied by the number of kernels per row. Traditional manual methods for measuring these two traits are time-consuming, limiting large-scale data collection. Recent automation efforts using image processing and deep learning encounter challenges such as high annotation costs and uncertain generalizability. We tackle these issues by exploring Large Vision Models for zero-shot, annotation-free maize kernel segmentation. By using an open-source large vision model, the Segment Anything Model (SAM), we segment individual kernels in RGB images of maize ears and apply a graph-based algorithm to calculate the number of kernels per row. Our approach successfully identifies the number of kernels per row across a wide range of maize ears, showing the potential of zero-shot learning with foundation vision models combined with image processing techniques to improve automation and reduce subjectivity in agronomic data collection. All our code is open-sourced to make these affordable phenotyping methods accessible to everyone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。