arXiv:2510.02213cs.CV2025-10

首个基于视觉变压器的多类别物体计数方法,提升密集场景下的计数精度。

Getting the Numbers Right$\unicode{x2014}$Modelling Multi-Class Object Counting in Dense and Varied Scenes

  • 用双塔SVT+多尺度CNN构建密度估计模型,融合层级特征应对不同密度
  • 在VisDrone和iSAID上MAE降低33%~64%,最拥挤样本性能超YOLO11一个数量级
  • 引入分类聚焦模块辅助训练,抑制类别干扰,不增加推理负担

密度图估计可在严重遮挡和高密度场景中实现精准物体计数,而基于检测的方法在此类场景下失效。在多类别密度估计中,通过非排他性建模类别信息,更贴合拥挤且视觉模糊的现实场景。然而,现有方法在低密度场景中性能下降,而最先进的检测器在极端拥挤场景仍表现不佳。为此,我们提出首个基于视觉变压器的多类别密度估计方法。模型采用双塔SVT金字塔视觉变压器主干网络,搭配多尺度CNN解码器,利用层级特征实现跨密度范围的鲁棒计数。此外,通过引入带有类别聚焦模块的辅助分割任务,在训练阶段抑制类别间干扰,无需在推理时施加约束假设,克服了以往方法的局限。在VisDrone和iSAID基准上的训练与评估表明,相比先前最优方法,测试阶段的MAE分别降低33%、43%和64%。该方法在较稀疏场景中优于YOLO11,而在最拥挤样本中性能超越其一个数量级。代码与训练权重已公开于https://github.com/LCAS/gnr_mcdest。

原文摘要 · Abstract (English)

Density map estimation enables accurate object counting in heavily occluded, and densely packed scenes where detection-based counting fails. In multi-class density estimation, class awareness can be introduced by modelling classes non-exclusively, better reflecting crowded and visually ambiguous contexts. However, existing multi-class density estimators often degrade in less-dense scenes, while state-of-the-art detectors still struggle in the most congested settings. To bridge this gap, we propose the first vision-transformer-based approach to multi-class density estimation. Our model combines a Twins-SVT pyramid vision transformer backbone with a multiscale CNN decoder that leverages hierarchical features for robust counting across a wide range of densities. Further to that, the method adds an auxiliary segmentation task with the Category Focus Module to suppress inter-category interference at training time. The module improves the density estimation head without the need for constraining assumptions added by the application of the auxiliary task at inference time, as required in previous methods. Training and evaluation on the VisDrone and iSAID benchmarks demonstrates a leap in performance versus the previous state-of-the-art multi-class density estimation methods, attaining a 33%, 43%, and 64% reduction to MAE in testing evaluation. The method outperforms YOLO11 in less busy scenes, exceeding it by an order of magnitude in the most crowded testing samples. Code, and trained weights available at https://github.com/LCAS/gnr_mcdest.

密度估计视觉变压器多类别计数密集场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。