arXiv:2501.00734cs.CVcs.LG2025-01中稿 · AAAI被引 2

提出新指标DDD,量化植物病害诊断中数据域差异与识别难度。

DDD: Discriminative Difficulty Distance for plant disease diagnosis

  • 用低维特征距离衡量训练与测试数据的域差异,定义新诊断难度指标DDD。
  • 在27个数据源、34类病害上验证,DDD与诊断难度相关性最高达0.909。
  • 适用于评估模型泛化能力,指导构建更鲁棒的植物病害数据集。

基于机器学习的植物病害诊断研究常因数据划分不当而高估性能,即训练与测试数据来自同一来源(域)。植物病害分类任务具有细粒度、症状模糊及域内图像特征差异大等挑战。本文提出判别难度距离(Discriminative Difficulty Distance, DDD),一种量化训练与测试数据域差距并评估测试数据分类难度的新指标。该指标可识别训练数据多样性不足问题,助力构建更鲁棒的数据集。研究使用244,063张涵盖4种作物、34类病害、来自27个域的植物病害图像,考察多个图像编码器在不同数据集上训练后的表现。结果表明,即使测试图像来自未参与编码器训练的作物或病害,其特征距离仍能有效构建与独立疾病分类器诊断难度高度相关的距离度量。相比仅在ImageNet21K预训练的基线编码器,相关性提升0.106至0.485,最高达0.909。

原文摘要 · Abstract (English)

Recent studies on plant disease diagnosis using machine learning (ML) have highlighted concerns about the overestimated diagnostic performance due to inappropriate data partitioning, where training and test datasets are derived from the same source (domain). Plant disease diagnosis presents a challenging classification task, characterized by its fine-grained nature, vague symptoms, and the extensive variability of image features within each domain. In this study, we propose the concept of Discriminative Difficulty Distance (DDD), a novel metric designed to quantify the domain gap between training and test datasets while assessing the classification difficulty of test data. DDD provides a valuable tool for identifying insufficient diversity in training data, thus supporting the development of more diverse and robust datasets. We investigated multiple image encoders trained on different datasets and examined whether the distances between datasets, measured using low-dimensional representations generated by the encoders, are suitable as a DDD metric. The study utilized 244,063 plant disease images spanning four crops and 34 disease classes collected from 27 domains. As a result, we demonstrated that even if the test images are from different crops or diseases than those used to train the encoder, incorporating them allows the construction of a distance measure for a dataset that strongly correlates with the difficulty of diagnosis indicated by the disease classifier developed independently. Compared to the base encoder, pre-trained only on ImageNet21K, the correlation higher by 0.106 to 0.485, reaching a maximum of 0.909.

病害诊断域差距深度学习图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。