用多边形直接检测物体轮廓,兼顾精度与效率。
Bridging Object Detection and Segmentation with Polygon Detection Transformers
- 基于极坐标表示,通过固定射线数生成轮廓近似多边形。
- 在COCO上比现有极坐标方法高4.7 mAP,高分辨率下更高效。
- 适合遥感、医疗影像等需精确几何形状的场景。
框检测与掩码分割是前景表达的两种主流范式:框效率高但形状粗略,掩码精确但对紧凑几何过度建模。为此,我们提出基于极坐标表示的多边形检测变压器(Poly-DETR),其中对象查询回归起始点及固定数量的径向距离,直接构建逼近轮廓的多边形。该形式可通过线性扩展集成至大多数DETR类检测器中,因为框是具有四条射线的极坐标表示退化情形。此外,我们提出两个简单但必要的设计:极坐标可变形注意力与位置感知训练方案,以对齐特征采样与多边形监督。作为极坐标表示的DETR导向改进,Poly-DETR在MS COCO上比现有极坐标方法提升4.7 mAP。进一步探索了多边形检测在几何驱动领域的应用,包括遥感、医学影像和自动驾驶。尤其在高分辨率场景中,Poly-DETR表现出比掩码基模型更强的可扩展性。额外实验表明,得益于其Transformer结构,Poly-DETR可自然扩展至配备基础模型先验的最新DETR变体。
原文摘要 · Abstract (English)
Box detection and mask segmentation are two dominant paradigms for foreground representation: boxes are efficient but too coarse for object shapes, while masks are accurate but over-modeled for compact geometry. To bridge this gap, we present a Polygon Detection Transformer (Poly-DETR) built upon Polar Representation, where object queries regress a starting point and its fixed number of radial distances to directly construct the contour-approximating polygon. This formulation can be integrated into most DETR-like detectors by linear extension, since box is a degenerate case of Polar Representation with four rays. Furthermore, we propose two simple but necessary designs, Polar Deformable Attention and Position-Aware Training Scheme, to align feature sampling and polygon supervision. As a DETR-oriented advancement of Polar Representation, Poly-DETR outperforms existing polar-based methods by 4.7 mAP on MS COCO. Moreover, we explore the application regimes of polygon detection in geometry-driven domains, including remote sensing, medical imaging, and autonomous driving. In particular, Poly-DETR shows stronger scalability than its mask-based counterpart in high-resolution scenarios. Additional experiments show that, owing to its Transformer structure, Poly-DETR can be naturally extended to recent DETR variants equipped with foundation-model priors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。