arXiv:2410.13842cs.CV2024-10被引 250

将DETR的框回归改为分布精炼,实现高精度实时检测

D-FINE: Redefine Regression Task in DETRs as Fine-grained Distribution Refinement

  • 用概率分布迭代优化替代固定坐标预测,提升定位精度
  • 在COCO上达55.8% AP,124 FPS,优于所有实时检测器
  • 轻量改造适配多种DETR模型,增益最高达5.3%且开销极小

本文提出D-FINE,一种高性能实时目标检测器,通过重新定义DETR中的边界框回归任务来显著提升定位精度。D-FINE包含两个核心组件:细粒度分布精炼(FDR)和全局最优定位自蒸馏(GO-LSD)。FDR将回归过程从预测固定坐标转变为迭代精炼概率分布,提供细粒度中间表示,大幅提升定位准确性;GO-LSD是一种双向优化策略,通过自蒸馏将精炼分布的知识传递至浅层,同时简化深层残差预测任务。此外,D-FINE在计算密集型模块中引入轻量优化,实现速度与精度的良好平衡。具体而言,D-FINE-L/X在NVIDIA T4 GPU上分别达到54.0%/55.8% AP,推理速度为124/78 FPS。预训练于Objects365后,其性能进一步提升至57.1%/59.3% AP,超越所有现有实时检测器。该方法可为多种DETR模型带来最高达5.3%的性能增益,且额外参数和训练成本几乎可忽略。代码与预训练模型详见:https://github.com/Peterande/D-FINE。

原文摘要 · Abstract (English)

We introduce D-FINE, a powerful real-time object detector that achieves outstanding localization precision by redefining the bounding box regression task in DETR models. D-FINE comprises two key components: Fine-grained Distribution Refinement (FDR) and Global Optimal Localization Self-Distillation (GO-LSD). FDR transforms the regression process from predicting fixed coordinates to iteratively refining probability distributions, providing a fine-grained intermediate representation that significantly enhances localization accuracy. GO-LSD is a bidirectional optimization strategy that transfers localization knowledge from refined distributions to shallower layers through self-distillation, while also simplifying the residual prediction tasks for deeper layers. Additionally, D-FINE incorporates lightweight optimizations in computationally intensive modules and operations, achieving a better balance between speed and accuracy. Specifically, D-FINE-L / X achieves 54.0% / 55.8% AP on the COCO dataset at 124 / 78 FPS on an NVIDIA T4 GPU. When pretrained on Objects365, D-FINE-L / X attains 57.1% / 59.3% AP, surpassing all existing real-time detectors. Furthermore, our method significantly enhances the performance of a wide range of DETR models by up to 5.3% AP with negligible extra parameters and training costs. Our code and pretrained models: https://github.com/Peterande/D-FINE.

目标检测DETR实时检测分布回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。