arXiv:2510.24374cs.CV2025-10AAAI被引 1

分离计数对象与视觉定位,提升细粒度物体计数准确率

Decoupling What to Count and Where to See for Referring Expression Counting

  • 用双查询机制分别处理'计什么'和'看哪里',聚焦属性区域特征
  • 在REC-8K数据集上误差降低22.5%(验证)和18.0%(测试)
  • 适合需要细粒度视觉理解的场景,如智能监控、机器人感知

参照表达计数(REC)将类别级目标计数扩展到细粒度子类级别,旨在统计符合文本描述中指定类别和区分性属性的对象。一个被忽视的根本挑战是:标注点通常位于类别代表性位置(如头部),迫使模型关注类别级特征,而忽略其他视觉区域(如腿部)中的属性信息。为此,我们提出W2-Net,一种通过双查询机制显式解耦问题的新框架。除标准的‘计什么’(w2c)查询外,还引入专用的‘看哪里’(w2s)查询,引导其从属性特定视觉区域提取特征,实现精准子类区分。此外,我们提出子类可分匹配(SSM),通过引入排斥力增强标签分配过程中的子类可分性。W2-Net在REC-8K数据集上显著优于现有方法,验证集计数误差降低22.5%,测试集降低18.0%,定位F1分别提升7%和8%。代码将公开。

原文摘要 · Abstract (English)

Referring Expression Counting (REC) extends class-level object counting to the fine-grained subclass-level, aiming to enumerate objects matching a textual expression that specifies both the class and distinguishing attribute. A fundamental challenge, however, has been overlooked: annotation points are typically placed on class-representative locations (e.g., heads), forcing models to focus on class-level features while neglecting attribute information from other visual regions (e.g., legs for "walking"). To address this, we propose W2-Net, a novel framework that explicitly decouples the problem into "what to count" and "where to see" via a dual-query mechanism. Specifically, alongside the standard what-to-count (w2c) queries that localize the object, we introduce dedicated where-to-see (w2s) queries. The w2s queries are guided to seek and extract features from attribute-specific visual regions, enabling precise subclass discrimination. Furthermore, we introduce Subclass Separable Matching (SSM), a novel matching strategy that incorporates a repulsive force to enhance inter-subclass separability during label assignment. W2-Net significantly outperforms the state-of-the-art on the REC-8K dataset, reducing counting error by 22.5% (validation) and 18.0% (test), and improving localization F1 by 7% and 8%, respectively. Code will be available.

细粒度计数视觉语言理解双查询机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。