梳理目标检测知识蒸馏的架构设计,帮开发者选对压缩方法
Architectural Insights into Knowledge Distillation for Object Detection: A Comprehensive Review
- 按检测器结构分层设计蒸馏策略,覆盖从主干到输出各环节
- 在MS COCO和PASCAL VOC上验证,不同方法[email protected]差异达2-5个百分点
- 适合想轻量化模型又不想丢精度的研究者和工程师参考
目标检测在深度学习推动下取得显著精度提升,但伴随计算开销增加,限制了在资源受限设备上的部署。知识蒸馏(KD)通过让小型学生模型学习大型教师模型,提供有效解决方案。然而,将KD应用于目标检测面临独特挑战:分类与定位双重目标、前景-背景不平衡及多尺度特征表示。本文提出一种以架构为中心的新分类体系,区分基于CNN的检测器(涵盖骨干层、颈部层、头部层以及RPN/RoI层蒸馏)和基于Transformer的检测器(包括查询级、特征级和逻辑值级蒸馏)。我们使用MS COCO和PASCAL VOC数据集,以[email protected]为评估指标,对代表性方法进行对比分析。该分类体系与评估旨在厘清目标检测中知识蒸馏的发展脉络,揭示当前挑战,并为构建高效可扩展的检测系统指明方向。
原文摘要 · Abstract (English)
Object detection has achieved remarkable accuracy through deep learning, yet these improvements often come with increased computational cost, limiting deployment on resource-constrained devices. Knowledge Distillation (KD) provides an effective solution by enabling compact student models to learn from larger teacher models. However, adapting KD to object detection poses unique challenges due to its dual objectives-classification and localization-as well as foreground-background imbalance and multi-scale feature representation. This review introduces a novel architecture-centric taxonomy for KD methods, distinguishing between CNN-based detectors (covering backbone-level, neck-level, head-level, and RPN/RoI-level distillation) and Transformer-based detectors (including query-level, feature-level, and logit-level distillation). We further evaluate representative methods using the MS COCO and PASCAL VOC datasets with [email protected] as performance metric, providing a comparative analysis of their effectiveness. The proposed taxonomy and analysis aim to clarify the evolving landscape of KD in object detection, highlight current challenges, and guide future research toward efficient and scalable detection systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。