无需训练,通过相似性引导提升密集小物体计数精度
AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Counting

- 用相似性图定位目标区域,动态调整图像分辨率和特征表示
- 在六大数据集上超越现有无训练方法,最高提升12.3%计数准确率
- 适合需要快速适配新类别、无标注数据的零样本计数场景
零样本物体计数(ZOC)旨在仅通过文本提示计数任意物体类别。近期无训练方法利用SAM等基础模型,将计数转化为提示驱动的分割任务,避免了昂贵的点级标注训练数据。然而,当场景中存在大量密集小物体时,由于图像分辨率有限且注意力不足,SAM3常漏检实例且难以区分重叠目标,影响计数准确性。为此,我们提出AdaCount,一种基于相似性引导的空间与特征自适应的无训练框架。AdaCount首先生成基于原型的相似性图,识别目标相关区域;随后引导两项互补操作:(i) 相似性引导的空间变形,将图像分辨率重分配至目标实例;(ii) 特征调制,增强目标相关编码器表征。两者协同使SAM3能更专注目标区域,同时保留全局上下文,无需任何模型重训练。在六个多样化的计数基准上的实验表明,AdaCount成为当前无训练方法中的新最优方案。
原文摘要 · Abstract (English)
Zero-shot object counting (ZOC) aims to count instances of arbitrary object categories specified only through textual prompts. Recent training-free approaches leverage foundation models such as SAM to reformulate counting as a prompt-driven segmentation task, eliminating the need for costly counting-specific training data with point-level annotations. More recently, SAM3 introduced promptable concept segmentation, enabling the zero-shot segmentation of all instances corresponding to a text-defined concept. However, SAM3 struggles in densely populated scenes containing numerous small objects, where limited image resolution and insufficient attention to target-relevant regions often lead to missed instances and poor instance separation, hindering accurate object counting. To address this limitation, we propose AdaCount, a training-free framework for ZOC based on similarity-guided spatial and feature adaptation. AdaCount first estimates a prototype-driven similarity map that identifies target-relevant regions. This similarity map subsequently guides two complementary adaptations: (i) similarity-guided spatial warping, which reallocates image resolution toward target instances, and (ii) feature modulation, which amplifies target-relevant encoder representations. Together, these adaptations enable SAM3 to devote greater representational capacity to target-relevant regions while preserving global image context, without requiring any model retraining. Extensive experiments across six diverse counting benchmarks establish AdaCount as a new SOTA among training-free ZOC approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。