通过位置感知判别分析,高效压缩目标检测模型。
Visual Detector Compression via Location-Aware Discriminant Analysis
- 利用定位信息主动优化检测判别能力,分步压缩网络
- 在KITTI和COCO上压缩后性能超越原始模型
- 适合资源受限设备上的检测模型部署
深度神经网络虽强大,但复杂度高,难以部署在数以亿计的资源受限边缘设备上。剪枝是关键的压缩技术,但现有方法多聚焦于分类模型,对检测任务关注不足,且未充分利用关键的定位信息。许多方法依赖预训练模型,导致有用与无用组件混杂,难以在不损伤性能的前提下剔除冗余部分。为此,本文提出一种主动式检测判别驱动的压缩方法,交替执行两个步骤:(1) 最大化并压缩与检测相关的判别能力,使其与检测头前的神经元/滤波器子集对齐;(2) 跟踪各层的检测判别能力,舍弃重要性较低的特征。两步均利用目标位置信息。在四个先进检测模型和四个主流竞争方法上,基于KITTI和COCO数据集的大量实验表明,该方法显著优于现有方案。令人惊讶的是,压缩后的模型甚至在性能上超过原基线模型,同时大幅降低复杂度。
原文摘要 · Abstract (English)
Deep neural networks are powerful, yet their high complexity greatly limits their potential to be deployed on billions of resource-constrained edge devices. Pruning is a crucial network compression technique, yet most existing methods focus on classification models, with limited attention to detection. Even among those addressing detection, there is a lack of utilization of essential localization information. Also, many pruning methods passively rely on pre-trained models, in which useful and useless components are intertwined, making it difficult to remove the latter without harming the former at the neuron/filter level. To address the above issues, in this paper, we propose a proactive detection-discriminants-based network compression approach for deep visual detectors, which alternates between two steps: (1) maximizing and compressing detection-related discriminants and aligning them with a subset of neurons/filters immediately before the detection head, and (2) tracing the detection-related discriminating power across the layers and discarding features of lower importance. Object location information is exploited in both steps. Extensive experiments, employing four advanced detection models and four state-of-the-art competing methods on the KITTI and COCO datasets, highlight the superiority of our approach. Remarkably, our compressed models can even beat the original base models with a substantial reduction in complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。