零样本物体计数新方法,通过三阶段筛选高质量样例提升计数精度。
CountZES: Counting via Zero-Shot Exemplar Selection
- 三阶段筛选:检测锚定、密度引导、特征共识,精准提取单实例样例。
- 在多个数据集上超越现有零样本计数方法,尤其在密集场景表现优异。
- 适合需要零样本泛化能力的物体计数任务,如未知类别监控场景。
复杂场景中的零样本(ZS)物体计数极具挑战性,需仅凭类别名称对未见类别进行计数。现有方法依赖预训练开放词汇检测器(OVD)生成样例,但在密集场景中易受语义噪声、外观变化和多实例提议干扰;随机图像块采样则难以准确分割实例。由于计数对样例质量敏感,这些策略常导致代表性不足,计数不准确。为此,我们提出CountZES,一种仅依赖推理的零样本样例选择方法。该方法通过三个协同阶段实现:检测锚定样例(DAE)精炼OVD检测结果以提取精确单实例样例;密度引导样例(DGE)引入自监督密度驱动机制,识别统计一致且语义紧凑的样例;特征共识样例(FCE)通过特征空间聚类强化视觉一致性。三者共同生成兼顾文本对齐、计数一致性和特征代表性的互补样例集。在多种数据集上的实验表明,CountZES在零样本计数(ZOC)任务中表现更优,并具备良好的跨域泛化能力。
原文摘要 · Abstract (English)
Object counting in complex scenes is particularly challenging in the zero-shot (ZS) setting, where instances of unseen categories are counted using only a class name. Existing ZS counting methods that infer exemplars from text often rely on off-the-shelf open-vocabulary detectors (OVDs), which in dense scenes suffer from semantic noise, appearance variability, and multi-instance proposals. Alternatively, random image-patch sampling is employed, which fails to accurately delineate object instances. Since counting is sensitive to exemplar quality, such selection strategies often yield poorly representative exemplars, leading to inaccurate count estimation. To address these issues, we propose CountZES, an inference-only approach for object counting via ZS exemplar selection. CountZES discovers diverse exemplars through three synergistic stages: Detection-Anchored Exemplar (DAE), Density-Guided Exemplar (DGE), and Feature-Consensus Exemplar (FCE). DAE refines OVD detections to isolate precise single-instance exemplars. DGE introduces a density-driven, self-supervised paradigm to identify statistically consistent and semantically compact exemplars, while FCE reinforces visual coherence through feature-space clustering. Together, these stages yield a complementary exemplar set that balances textual grounding, count consistency, and feature representativeness. Experiments on diverse datasets demonstrate CountZES superior performance among ZOC methods while generalizing effectively across domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。