arXiv:2411.02861cs.CV2024-11被引 2

针对无人机图像小目标检测,提出新知识蒸馏方法提升精度与效率。

Centerness-based Instance-aware Knowledge Distillation with Task-wise Mutual Lifting for Object Detection on Drone Imagery

  • 基于中心度设计实例感知蒸馏,聚焦目标周围区域增强学习。
  • 引入任务间互升模块,协同优化分类与定位分支,提升学生模型训练效果。
  • 在三个公开数据集上显著超越现有蒸馏方法,适合边缘部署的检测场景。

由于航拍场景复杂,构建高效准确的无人机图像目标检测器极具挑战。现有方法多依赖大模型以追求高精度,但计算开销难以在无人机上部署。知识蒸馏(KD)在通用目标检测中展现出压缩模型同时保持精度的潜力。本文首次将知识蒸馏应用于无人机图像目标检测,针对低前景背景比、小目标及复杂背景导致的训练不足问题,提出任务级轻量级互升(Light-ML)模块与基于中心度的实例感知蒸馏(CID)策略。Light-ML通过通道混洗与卷积,在反向传播中整合不同任务的教师监督,协同优化分类与定位分支;CID利用提议框的中心度提取目标周边有效区域,增强蒸馏信号。在VisDrone、UAVDT和COCO数据集上的实验表明,该方法在相近计算量下显著提升现有先进蒸馏方法的性能。代码将在论文接收后开源。

原文摘要 · Abstract (English)

Developing accurate and efficient detectors for drone imagery is challenging due to the inherent complexity of aerial scenes. While some existing methods aim to achieve high accuracy by utilizing larger models, their computational cost is prohibitive for drones. Recently, Knowledge Distillation (KD) has shown promising potential for maintaining satisfactory accuracy while significantly compressing models in general object detection. Considering the advantages of KD, this paper presents the first attempt to adapt it to object detection on drone imagery and addresses two intrinsic issues: (1) low foreground-background ratio and (2) small instances and complex backgrounds, which lead to inadequate training, resulting insufficient distillation. Therefore, we propose a task-wise Lightweight Mutual Lifting (Light-ML) module with a Centerness-based Instance-aware Distillation (CID) strategy. The Light-ML module mutually harmonizes the classification and localization branches by channel shuffling and convolution, integrating teacher supervision across different tasks during back-propagation, thus facilitating training the student model. The CID strategy extracts valuable regions surrounding instances through the centerness of proposals, enhancing distillation efficacy. Experiments on the VisDrone, UAVDT, and COCO benchmarks demonstrate that the proposed approach promotes the accuracies of existing state-of-the-art KD methods with comparable computational requirements. Codes will be available upon acceptance.

目标检测知识蒸馏无人机图像小目标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。