arXiv:2501.17688cs.CVcs.AI2025-01被引 7

基于轮廓的实时实例分割新模型,精度与速度兼备。

ContourFormer: Real-Time Contour-Based End-to-End Instance Segmentation Transformer

  • 采用DETR框架,通过迭代优化轮廓实现端到端分割。
  • 在COCO等数据集上显著提升精度,推理速度达实时要求。
  • 适合需要高精度轮廓分割的实时应用场景。

本文提出Contourformer,一种基于轮廓的实时实例分割算法。该方法完全基于DETR范式,通过迭代与渐进机制优化轮廓,实现端到端推理。为提升效率与精度,提出了两种新技巧:子轮廓解耦机制和轮廓细粒度分布精修。子轮廓解耦机制设计了一种基于可变形注意力的模块,根据当前预测轮廓自适应选择采样区域,更有效捕捉物体边界信息;同时引入多阶段优化流程,逐步细化子轮廓以增强分割精度。轮廓细粒度分布精修技术进一步提升了对轮廓细节的表达能力。这些创新使Contourformer在保持实时性能的同时,对每个实例实现稳定且精确的分割。大量实验表明,其在SBD、COCO和KINS等多个基准数据集上均优于现有先进方法,在准确率与推理速度上均有显著提升。本工作为轮廓基实例分割任务提供了新解决方案,并有望成为该领域的重要基线方法。

原文摘要 · Abstract (English)

This paper presents Contourformer, a real-time contour-based instance segmentation algorithm. The method is fully based on the DETR paradigm and achieves end-to-end inference through iterative and progressive mechanisms to optimize contours. To improve efficiency and accuracy, we develop two novel techniques: sub-contour decoupling mechanisms and contour fine-grained distribution refinement. In the sub-contour decoupling mechanism, we propose a deformable attention-based module that adaptively selects sampling regions based on the current predicted contour, enabling more effective capturing of object boundary information. Additionally, we design a multi-stage optimization process to enhance segmentation precision by progressively refining sub-contours. The contour fine-grained distribution refinement technique aims to further improve the ability to express fine details of contours. These innovations enable Contourformer to achieve stable and precise segmentation for each instance while maintaining real-time performance. Extensive experiments demonstrate the superior performance of Contourformer on multiple benchmark datasets, including SBD, COCO, and KINS. We conduct comprehensive evaluations and comparisons with existing state-of-the-art methods, showing significant improvements in both accuracy and inference speed. This work provides a new solution for contour-based instance segmentation tasks and lays a foundation for future research, with the potential to become a strong baseline method in this field.

实例分割轮廓优化Transformer实时推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。