用视觉模型分析蔓越莓成熟过程,支持精准农业育种决策。
Agtech Framework for Cranberry-Ripening Analysis Using Vision Foundation Models
- 结合无人机与手持相机多时相成像,提取蔓越莓外观特征。
- 通过ViT+UMAP构建2D外观流形,量化成熟路径与成熟速率。
- 首次实现蔓越莓品种成熟差异的定量比较,适合农学研究者。
农业领域正因人工智能与计算机视觉的进步而变革,支持对作物进行量化视觉评估。本研究利用航拍与地面图像的时间序列数据,建立了一套分析蔓越莓成熟过程的框架,该过程对精准农业中的品种比较(高通量表型分析)和病害检测至关重要。通过无人机在多个地块采集20个观测点的图像,同时使用手持相机对同一地块进行固定标记的地面拍摄,重复采集覆盖整个生长季的多周数据。航拍图像用于计算反照率分布,地面图像则可追踪单颗果实以观察外观变化。采用视觉变换器(ViT)进行分割后特征提取,生成高维外观描述符。为提升可解释性,利用UMAP对ViT特征降维生成2D外观流形,从而量化成熟路径并定义成熟速率指标。基于此方法,我们比较了四种蔓越莓品种的成熟表现。本工作为首个此类研究,未来可推广至葡萄、橄榄、蓝莓和玉米等作物。航拍与地面数据集已公开共享。
原文摘要 · Abstract (English)
Agricultural domains are being transformed by recent advances in AI and computer vision that support quantitative visual evaluation. Using aerial and ground imaging over a time series, we develop a framework for characterizing the ripening process of cranberry crops, a crucial component for precision agriculture tasks such as comparing crop breeds (high-throughput phenotyping) and detecting disease. Using drone imaging, we capture images from 20 waypoints across multiple bogs, and using ground-based imaging (hand-held camera), we image same bog patch using fixed fiducial markers. Both imaging methods are repeated to gather a multi-week time series spanning the entire growing season. Aerial imaging provides multiple samples to compute a distribution of albedo values. Ground imaging enables tracking of individual berries for a detailed view of berry appearance changes. Using vision transformers (ViT) for feature detection after segmentation, we extract a high dimensional feature descriptor of berry appearance. Interpretability of appearance is critical for plant biologists and cranberry growers to support crop breeding decisions (e.g.\ comparison of berry varieties from breeding programs). For interpretability, we create a 2D manifold of cranberry appearance by using a UMAP dimensionality reduction on ViT features. This projection enables quantification of ripening paths and a useful metric of ripening rate. We demonstrate the comparison of four cranberry varieties based on our ripening assessments. This work is the first of its kind and has future impact for cranberries and for other crops including wine grapes, olives, blueberries, and maize. Aerial and ground datasets are made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。