通过检测与分割的迭代交互,提升目标检测和实例分割精度。
A Turbo-Inference Strategy for Object Detection and Instance Segmentation

- 设计双模块闭环结构,让检测与分割任务相互优化
- 在COCO等数据集上检测与分割精度均显著提升
- 无需重训练,适合对精度有要求的部署场景
目标检测与实例分割任务密切相关。现有基于自顶向下的实例分割方法通常采用先检测后分割的范式,即先用检测器识别并定位物体的边界框,再在每个边界框内进行实例掩码分割。在此类方法中,检测精度直接影响后续分割性能。然而,以往研究很少探讨实例分割任务对目标检测的影响。本文提出一种针对自顶向下方法的快速推理策略,通过迭代利用检测与分割任务之间的互补信息实现协同优化。具体设计了两个模块:涡轮检测头与涡轮分割头,促进两任务间的通信。这两个模块构成闭环,可在不重新训练模型的前提下交织融合检测与分割结果。在COCO、iFLYTEK和Cityscapes数据集上的全面实验表明,该方法在适度增加计算开销的情况下,显著提升了检测与分割的准确率。所提方法在预测精度与推理速度之间实现了良好权衡。代码已公开于https://github.com/zhaozhen2333/Turbo-Learning.git。
原文摘要 · Abstract (English)
Object detection and instance segmentation tasks are closely related. Existing top-down instance segmentation methods usually follow a detect-then-segment paradigm, where an initial detector is used to recognize and localize objects with bounding boxes, followed by the segmentation of an instance mask within each bounding box. In such methods, the detection accuracy directly influences the subsequent segmentation performance. However, previous research has seldom explored the impact of the instance segmentation task on object detection. In this paper, we present a turbo-inference strategy for the top-down methods that leverages the complementary information between detection and segmentation tasks iteratively. Specifically we design two modules: turbo-detection head and turbo-segmentation head, which facilitate communication between the tasks. The two modules form a closed loop that interlaces the detection and segmentation results without retraining the model. Comprehensive experiments on the COCO, iFLYTEK, and Cityscapes datasets demonstrate that our method substantially enhances both detection and segmentation accuracies with a certain increase in computational cost. The proposed method represents a tradeoff between prediction accuracy and inference speed. Codes are available at https://github.com/zhaozhen2333/Turbo-Learning.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。