arXiv:2606.17650cs.CVcs.CL2026-06

用新型架构实现高效文本引导物体计数,精度达领先水平。

MambaCount: Efficient Text-guided Open-vocabulary Object Counting with Spatial Sparse State Space Duality Block

论文配图:MambaCount: Efficient Text-guided Open-vocabulary Object Counting with Spatial Sparse State Space Duality Block
图 1 · 摘自论文原文
  • 基于空间稀疏状态空间双重块构建新模型
  • 在FSC-147上达12.23的测试平均绝对误差
  • 适合需要快速推理与高精度的开放词汇计数场景

文本引导开放词汇物体计数(TOOC)旨在估计文本提示描述的物体数量,尤其在密集场景和大尺度变化下极具挑战性。现有方法多依赖Transformer,其图像分辨率相关的二次复杂度限制了可扩展性。Mamba因其线性复杂度成为潜在替代方案,但先前的Mamba方法存在两大缺陷:一方面,Mamba固有的因果建模限制了视觉任务所需的双向空间依赖建模;另一方面,现有Mamba视觉模型常忽视空间令牌响应中的无约束高熵,削弱了局部细节与高频信息。为此,我们提出MambaCount,基于空间稀疏状态空间双重(S^4D)块构建高效框架。具体而言,我们分析并重构了Mamba中隐藏状态的衰减动态,缓解因果建模带来的依赖约束;同时引入空间令牌选择(STS)子模块,降低空间令牌响应中的高熵。此外,设计多粒度原型(MGP),在不同语义层次识别类物体区域,提升跨模态对齐与可解释性。在FSC-147上的大量实验表明,MambaCount在无需二次查询的方法中达到当前最优性能,测试MAE为12.23,同时保持线性复杂度。

原文摘要 · Abstract (English)

Text-guided Open-vocabulary Object Counting (TOOC) aims to estimate the number of objects described by text prompts, which is particularly challenging in dense scenes with large scale variations. Existing TOOC approaches predominantly rely on Transformers, whose quadratic complexity with respect to image resolution limits their scalability. Mamba offers a promising alternative due to its linear complexity. However, previous Mamba-based methods have two main limitations. On the one hand, the inherent causal formulation of Mamba constrains the bidirectional spatial dependency modeling required by non-causal vision tasks. On the other hand, existing Mamba-based vision models often overlook the unconstrained high entropy in the spatial token responses, which can weaken local details and high-frequency cues. To address these limitations, we propose MambaCount, an efficient framework built on the Spatial Sparse State Space Duality (S^4D) block. Specifically, we analyze and reconstruct the decay dynamics of hidden states in Mamba to alleviate the dependency constraints introduced by causal modeling. Moreover, we introduce a Spatial Token Selection (STS) sub-block to reduce the unconstrained high entropy in spatial token responses within Mamba. In addition, we design Multi-Granularity Prototypes (MGP) to identify object-like regions at different semantic levels, improving cross-modal alignment and interpretability. Extensive experiments on FSC-147 demonstrate that MambaCount achieves state-of-the-art performance among methods without secondary querying, obtaining a test MAE of 12.23, while retaining linear complexity.

物体计数Mamba文本引导高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。