提升小目标与任意方向物体检测性能,通过几何感知解码和动态匹配优化
Explore Intrinsic Geometry for Query-based Tiny and Oriented Object Detector with Momentum-based Bipartite Matching
- 引入几何感知解码器,利用对象查询推导几何嵌入以捕捉方向布局
- 在DOTA-V1.0上达78.00%的AP50,单尺度下优于现有方法
- 适合无人机航拍等复杂场景中的小目标、定向目标检测任务
基于查询的检测器虽进展显著,但在处理任意方向的小型物体时仍受限于纹理信息不足及阶段间匹配不一致问题。本文提出IGOFormer,通过显式融合内在几何信息到特征解码中,并增强跨阶段匹配稳定性。设计了几何感知解码器,基于对象查询提取互补几何嵌入,以揭示对象的方向结构;同时提出基于动量的二分匹配策略,通过查询特定平滑因子构建指数移动平均,有效缓解因阶段匹配不一致引发的冲突监督信号。大量实验与消融研究验证了其有效性,在使用Swin-T主干网络的单尺度设置下,于DOTA-V1.0数据集上达到78.00%的AP$_{50}$。代码将公开。
原文摘要 · Abstract (English)
Recent query-based detectors have achieved remarkable progress, yet their performance remains constrained when handling objects with arbitrary orientations, especially for tiny objects capturing limited texture information. This limitation primarily stems from the underutilization of intrinsic geometry during pixel-based feature decoding and the occurrence of inter-stage matching inconsistency caused by stage-wise bipartite matching. To tackle these challenges, we present IGOFormer, a novel query-based oriented object detector that explicitly integrates intrinsic geometry into feature decoding and enhances inter-stage matching stability. Specifically, we design an Intrinsic Geometry-aware Decoder, which enhances the object-related features conditioned on an object query by injecting complementary geometric embeddings extrapolated from their correlations to capture the geometric layout of the object, thereby offering a critical geometric insight into its orientation. Meanwhile, a Momentum-based Bipartite Matching scheme is developed to adaptively aggregate historical matching costs by formulating an exponential moving average with query-specific smoothing factors, effectively preventing conflicting supervisory signals arising from inter-stage matching inconsistency. Extensive experiments and ablation studies demonstrate the superiority of our IGOFormer for aerial oriented object detection, achieving an AP$_{50}$ score of 78.00\% on DOTA-V1.0 using Swin-T backbone under the single-scale setting. The code will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。