arXiv:2604.26806cs.CVcs.AI2026-04

不训练也能提升小目标检测,通过动态裁剪注意力区域来增强细节

ViCrop-Det: Spatial Attention Entropy Guided Cropping for Training-Free Small-Object Detection

论文配图:ViCrop-Det: Spatial Attention Entropy Guided Cropping for Training-Free Small-Object Detection
图 1 · 摘自论文原文
  • 用注意力熵识别模糊区域,动态裁剪空间范围聚焦关键局部
  • 在VisDrone和DOTA上提升1-3个mAP@50,延迟仅增加20%-23%
  • 无需修改模型结构,适合资源受限的实时小目标检测场景

基于Transformer的架构在全局语义感知中占据主导地位,但其均匀全局感受野难以应对自然图像中固有的空间异质性。不同信息密度区域的统一感受野导致局部特征退化,尤其在密集冲突区的小目标检测中表现不佳。为此,我们提出ViCrop-Det,一种无需训练的推理框架,引入自适应空间信任区域收缩机制。受异常分割中注意力熵启发,该框架利用检测解码器的交叉注意力分布作为内生探针,通过空间注意力熵(SAE)评估局部空间模糊性,实现动态空间路由:将固定计算预算仅分配给高目标显著性与高认知不确定性的区域。通过缩小空间信任区域并注入高频局部观测,ViCrop-Det主动缓解空间模糊,恢复细粒度特征,且无需架构修改。在VisDrone和DOTA-v1.5上的大量实验表明,ViCrop-Det在保持轻量的前提下,使RT-DETR-R50和Deformable DETR的mAP@50稳定提升1-3个百分点,延迟仅增加20%-23%。在MS COCO上,$AP_{S}$提升而$AP_{M}/AP_{L}$保持稳定,说明在不破坏全局空间先验的前提下实现了精准的细尺度优化。在计算量匹配条件下,该自适应路由策略全面超越均匀切片基线,达成更优的精度-速度权衡。

原文摘要 · Abstract (English)

Transformer-based architectures have established a dominant paradigm in global semantic perception; however, they remain fundamentally constrained by the profound spatial heterogeneity inherent in natural images. Specifically, the imposition of a uniform global receptive field across regions of varying information density inevitably leads to local feature degradation, particularly in dense conflict zones populated by microscopic targets. To address this mechanistic limitation, we propose ViCrop-Det, a training-free inference framework that introduces adaptive spatial trust region shrinkage. Inspired by the use of attention entropy in anomaly segmentation, ViCrop-Det leverages the detection decoder's cross-attention distribution as an endogenous probe. By utilizing Spatial Attention Entropy (SAE) to heuristically evaluate local spatial ambiguity, the framework executes dynamic spatial routing, allocating a fixed computational budget exclusively to regions exhibiting both high target saliency and high cognitive uncertainty. By shrinking the spatial trust region and injecting high-frequency localized observations, ViCrop-Det actively resolves spatial ambiguity and recovers fine-grained features without requiring architectural modifications. Extensive evaluations on VisDrone and DOTA-v1.5 demonstrate that ViCrop-Det yields competitive performance enhancements, consistently adding +1-3 mAP@50 to RT-DETR-R50 and Deformable DETR with a marginal 20-23\% latency overhead. On MS COCO, $AP_{S}$ improves while $AP_{M}/AP_{L}$ remains stable, indicating precise fine-scale refinement without compromising the global spatial prior. Under compute-matched settings, our adaptive routing strategy comprehensively surpasses uniform slicing baselines, achieving a highly optimized accuracy-speed trade-off.

小目标检测注意力机制无训练Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。