用自监督方法提升葡萄品种图像识别准确率,解决小样本难题。
Advancing Image-Based Grapevine Variety Classification with a New Benchmark and Evaluation of Masked Autoencoders
- 采用掩码自编码器在无标签图像上预训练,避免领域偏移问题。
- 在43个品种数据集上实现0.7956的F1分数,优于所有对比模型。
- 适合农业图像识别研究者,尤其关注小样本与低资源场景。
葡萄品种对众多葡萄酒生产国经济至关重要,影响葡萄酒、果汁及果叶的生产与消费。传统鉴定方法如植株形态学和分子分析存在局限:前者依赖专家主观判断,后者成本高且耗时。近年来,研究者尝试利用图像数据通过深度学习分类葡萄品种,但受限于数据量小,普遍依赖ImageNet1K等外部数据集进行迁移学习,易引发领域偏移与监督衰减。为此,本文评估了掩码自编码器(MAE)在葡萄品种识别中的应用。研究构建了两个涵盖43个葡萄品种、跨季节采集的新基准数据集,分析了MAE在农业场景下的表现,并比较了不同季节训练模型的性能。结果表明,使用未标注数据预训练的ViT-B/16模型在测试集上达到0.7956的F1分数,显著优于其他模型。此外,长周期预训练更有效,小样本训练下表现稳健,且简单数据增强优于复杂策略;掩码比例对性能影响较小。
原文摘要 · Abstract (English)
Grapevine varieties are essential for the economies of many wine-producing countries, influencing the production of wine, juice, and the consumption of fruits and leaves. Traditional identification methods, such as ampelography and molecular analysis, have limitations: ampelography depends on expert knowledge and is inherently subjective, while molecular methods are costly and time-intensive. To address these limitations, recent studies have applied deep learning (DL) models to classify grapevine varieties using image data. However, due to the small dataset sizes, these methods often depend on transfer learning from datasets from other domains, e.g., ImageNet1K (IN1K), which can lead to performance degradation due to domain shift and supervision collapse. In this context, self-supervised learning (SSL) methods can be a good tool to avoid this performance degradation, since they can learn directly from data, without external labels. This study presents an evaluation of Masked Autoencoders (MAEs) for identifying grapevine varieties based on field-acquired images. The main contributions of this study include two benchmarks comprising 43 grapevine varieties collected across different seasons, an analysis of MAE's application in the agricultural context, and a performance comparison of trained models across seasons. Our results show that a ViT-B/16 model pre-trained with MAE and the unlabeled dataset achieved an F1 score of 0.7956, outperforming all other models. Additionally, we observed that pre-trained models benefit from long pre-training, perform well under low-data training regime, and that simple data augmentation methods are more effective than complex ones. The study also found that the mask ratio in MAE impacts performance only marginally.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。