arXiv:2605.25046cs.CVcs.AI2026-05

TinyFormer融合YOLO与DETR优势,精准检测小目标。

TinyFormer: Preserving Tiny Objects in YOLO-DETR Hybrid Real-time Detectors

论文配图:TinyFormer: Preserving Tiny Objects in YOLO-DETR Hybrid Real-time Detectors
图 1 · 摘自论文原文
  • 用并行双路融合模块保留浅层细节,提升小目标特征
  • 在COCO上小目标AP提升1.6%,总AP达58.5%
  • 无需后处理,适合实时小目标检测场景

YOLO系列和基于DETR的检测器在小目标检测上表现不佳。YOLO类模型虽有高效密集预测,但深层特征图的大步幅主干网络会抑制小目标,且网格分配模糊;DETR类模型通过集合预测消除手工后处理,但依赖粗粒度令牌网格,小目标仅占少数弱令牌,易被忽略。为此,我们提出TinyFormer,一种统一的YOLO-DETR混合实时检测器,结合视觉变换器表示、无NMS集合预测及YOLO风格金字塔颈部,实现精准小目标检测。TinyFormer引入并行双融合模块(PBM),从浅层阶段构建高分辨率捷径至特征金字塔,保留多尺度融合中的精细空间细节。进一步设计空间语义适配器(SSA),从早期阶段提取高分辨率线索并注入变换器令牌嵌入,改善小目标定位,同时不牺牲DETR的全局建模能力。在MS COCO上的实验表明,TinyFormer持续优于近期YOLO系列检测器和强基线DEIMv2。TinyFormer-X在无PBM时达到58.4% AP,加入PBM后总体AP升至58.5%,小目标AP提升1.6%。经Objects365预训练后,TinyFormer-X-PBM达60.2% AP,超越RF-DETR及其他预训练检测器,参数更少、计算量更低。结果表明,TinyFormer弥合了密集的YOLO式特征融合与DETR式集合预测之间的差距,为实时小目标检测提供了优异的精度-效率平衡。代码已开源。

原文摘要 · Abstract (English)

YOLO-series and DETR-based detectors struggle with tiny-object detection. YOLO-style models benefit from efficient dense prediction, but their large-stride backbones may suppress tiny instances in deep feature maps and make grid assignment ambiguous. DETR-based models remove hand-crafted post-processing through set prediction, yet they reason over coarse token grids, where tiny objects occupy only a few weak tokens and are easily overlooked during matching. To address these limitations, we propose TinyFormer, a unified YOLO--DETR hybrid real-time detector that combines ViT representations, NMS-free set prediction, and a YOLO-style pyramid neck for accurate small-object detection. TinyFormer introduces a Parallel Bi-fusion Module (PBM), which builds high-resolution shortcuts from shallow stages to the feature pyramid, preserving fine spatial details during multi-scale fusion. We further design a Spatial Semantic Adapter (SSA) to compensate for the spatial loss caused by coarse tokenization. SSA extracts high-resolution cues from early stages and injects them into transformer token embeddings, improving tiny-object localization without sacrificing the global modeling ability of DETR. Experiments on MS COCO show that TinyFormer consistently outperforms recent YOLO-series detectors and the strong DEIMv2 baseline. TinyFormer-X achieves 58.4% AP even without PBM, while adding PBM improves the overall AP to 58.5% and brings a 1.6% AP gain on small objects. With Objects365 pre-training, TinyFormer-X-PBM reaches 60.2% AP, surpassing RF-DETR and other Objects365-pretrained detectors with fewer parameters and lower computation. These results demonstrate that TinyFormer bridges dense YOLO-style feature fusion and DETR-style set prediction, providing a strong accuracy-efficiency trade-off for real-time tiny-object detection. Code is available at https://github.com/mmpmmpmmpjosh/TinyFormer.

小目标检测实时检测混合模型视觉变换器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。