用点标注训练网络,实现果园中花果密度与位置的精准估计
AgRegNet: A Deep Regression Network for Flower and Fruit Density Estimation, Localization, and Counting in Orchards
- 基于点标注的深度回归网络,无需目标检测或轮廓标注
- 花果估计的SSIM达0.938,误差仅13.7%,定位精度mAP达0.81
- 适用于稀疏与密集分布场景,适合农户进行产量预估和疏花决策
当前农业面临人工劳动力不确定性与成本高的挑战。自动化花果密度估计、定位与计数有助于优化采摘、产量预测及作物负载管理(如疏花疏果)。本文提出一种基于深度回归的网络AgRegNet,无需显式目标检测或多边形标注,即可在非结构化果园环境中估计树冠内花果的密度、数量与中心位置。受U-Net启发,AgRegNet采用编码器-解码器结构,以改进的ConvNeXt-T为编码器,并引入空间与通道注意力模块,增强花果特征,抑制背景干扰。实验基于苹果花果冠层图像,在未结构化果园环境下评估,结果显示:花图像的结构相似性指数(SSIM)为0.938,平均绝对误差百分比(pMAE)为13.7%,平均精度均值(mAP)为0.81;果图像对应值分别为0.910、5.6%和0.93。该方法依赖点标注信息,适用于稀疏与密集分布对象,可为种植者提供精准产量预估与化学/机械疏花决策支持。
原文摘要 · Abstract (English)
One of the major challenges for the agricultural industry today is the uncertainty in manual labor availability and the associated cost. Automated flower and fruit density estimation, localization, and counting could help streamline harvesting, yield estimation, and crop-load management strategies such as flower and fruitlet thinning. This article proposes a deep regression-based network, AgRegNet, to estimate density, count, and location of flower and fruit in tree fruit canopies without explicit object detection or polygon annotation. Inspired by popular U-Net architecture, AgRegNet is a U-shaped network with an encoder-to-decoder skip connection and modified ConvNeXt-T as an encoder feature extractor. AgRegNet can be trained based on information from point annotation and leverages segmentation information and attention modules (spatial and channel) to highlight relevant flower and fruit features while suppressing non-relevant background features. Experimental evaluation in apple flower and fruit canopy images under an unstructured orchard environment showed that AgRegNet achieved promising accuracy as measured by Structural Similarity Index (SSIM), percentage Mean Absolute Error (pMAE) and mean Average Precision (mAP) to estimate flower and fruit density, count, and centroid location, respectively. Specifically, the SSIM, pMAE, and mAP values for flower images were 0.938, 13.7%, and 0.81, respectively. For fruit images, the corresponding values were 0.910, 5.6%, and 0.93. Since the proposed approach relies on information from point annotation, it is suitable for sparsely and densely located objects. This simplified technique will be highly applicable for growers to accurately estimate yields and decide on optimal chemical and mechanical flower thinning practices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。