arXiv:2412.02054cs.CV2024-12AAAI被引 7

提出轻量剪枝法,让3D检测模型少用冗余查询,提速省资源。

Redundant Queries in DETR-Based 3D Detection Methods: Unnecessary and Prunable

  • 按分类得分逐步剪掉无用查询,无需新增参数。
  • 推理速度最高提升1.35倍,边缘设备算力降低67.86%。
  • 可直接用于已有模型微调,适合部署优化场景。

基于查询的模型在3D目标检测中广泛应用,但通常使用远超实际目标数的查询,导致计算与内存浪费。本文发现并非所有查询贡献均等,部分查询影响极小。为此提出无需额外参数的渐进式查询剪枝方法(GPQ),通过分类得分逐步移除冗余查询。该方法可无缝集成于任意查询型模型,作为训练后微调步骤。实验表明,多种先进3D检测器采用GPQ后,性能保持不变,桌面GPU推理速度最高提升1.35倍;部署至边缘设备时,浮点运算量减少67.86%,推理时间下降65.16%。代码将开源。

原文摘要 · Abstract (English)

Query-based models are extensively used in 3D object detection tasks, with a wide range of pre-trained checkpoints readily available online. However, despite their popularity, these models often require an excessive number of object queries, far surpassing the actual number of objects to detect. The redundant queries result in unnecessary computational and memory costs. In this paper, we find that not all queries contribute equally -- a significant portion of queries have a much smaller impact compared to others. Based on this observation, we propose an embarrassingly simple approach called Gradually Pruning Queries (GPQ), which prunes queries incrementally based on their classification scores. A key advantage of GPQ is that it requires no additional learnable parameters. It is straightforward to implement in any query-based method, as it can be seamlessly integrated as a fine-tuning step using an existing checkpoint after training. With GPQ, users can easily generate multiple models with fewer queries, starting from a checkpoint with an excessive number of queries. Experiments on various advanced 3D detectors show that GPQ effectively reduces redundant queries while maintaining performance. Using our method, model inference on desktop GPUs can be accelerated by up to 1.35x. Moreover, after deployment on edge devices, it achieves up to a 67.86% reduction in FLOPs and a 65.16% decrease in inference time. The code will be available at https://github.com/iseri27/Gpq.

3D检测查询剪枝模型压缩边缘部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。