arXiv:2409.01573cs.CVcs.AI2024-09

通过模拟遮挡提升苹果检测鲁棒性,让模型更抗遮挡干扰。

Improving Apple Object Detection with Occlusion-Enhanced Distillation

  • 构建含自然遮挡的苹果数据集,用分割模型提取叶枝等遮挡物
  • 多尺度知识蒸馏使学生网络学得更稳定,对遮挡不敏感
  • 适合农业视觉检测、复杂场景目标识别任务使用

苹果在自然环境中生长时常被叶片和枝条严重遮挡,显著增加目标检测中的误检风险,提升检测难度。为此,本文提出“遮挡增强型知识蒸馏”(Occlusion-Enhanced Distillation, OED)方法。首先,基于Grounding DINO与SAM模型构建含遮挡的苹果数据集,精准提取每张图像中的叶、枝等遮挡元素,生成反映果实自然生长状态的遮挡样本。其次,提出多尺度知识蒸馏策略:学生网络输入人为增加遮挡的图像,教师网络则使用无自然遮挡的图像,引导学生在网络不同层级上实现语义与局部特征的对齐,有效缩小遮挡与非遮挡目标间的特征距离,提升检测鲁棒性。最后,引入指数移动平均(EMA)策略,增强学生网络训练稳定性,使其学习到更泛化的特征表达,减少单张图像遮挡噪声的影响。大量对比实验表明,该方法显著优于当前最优技术。

原文摘要 · Abstract (English)

Apples growing in natural environments often face severe visual obstructions from leaves and branches. This significantly increases the risk of false detections in object detection tasks, thereby escalating the challenge. Addressing this issue, we introduce a technique called "Occlusion-Enhanced Distillation" (OED). This approach utilizes occlusion information to regularize the learning of semantically aligned features on occluded datasets and employs Exponential Moving Average (EMA) to enhance training stability. Specifically, we first design an occlusion-enhanced dataset that integrates Grounding DINO and SAM methods to extract occluding elements such as leaves and branches from each sample, creating occlusion examples that reflect the natural growth state of fruits. Additionally, we propose a multi-scale knowledge distillation strategy, where the student network uses images with increased occlusions as inputs, while the teacher network employs images without natural occlusions. Through this setup, the strategy guides the student network to learn from the teacher across scales of semantic and local features alignment, effectively narrowing the feature distance between occluded and non-occluded targets and enhancing the robustness of object detection. Lastly, to improve the stability of the student network, we introduce the EMA strategy, which aids the student network in learning more generalized feature expressions that are less affected by the noise of individual image occlusions. Our method significantly outperforms current state-of-the-art techniques through extensive comparative experiments.

目标检测遮挡处理知识蒸馏农业图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。