仅用人数总数训练,就能生成精准人群密度图。
Count2Density: Crowd Density Estimation without Location-level Annotations
- 用历史密度图库和超几何采样生成伪密度图
- 在多个数据集上超越现有半监督方法
- 适合缺乏精细标注的现实场景应用
人群密度估计是计算机视觉中的一项经典任务,旨在预测图像中人群的空间分布密度。该领域主要依赖细粒度的位置级标注(即在每个人头上打点),但这类标注繁琐耗时,严重制约了实际应用的可扩展性。为缓解这一问题,本文提出Count2Density:一种仅需计数级标注(即总人数)即可训练的新型框架,通过历史密度图库生成伪密度图,利用过去预测结果减少偏差。该图库初始由无监督显著性估计器提供空间先验,并通过预测密度图的指数移动平均(EMA)持续更新。伪密度图通过超几何分布从估计的人群区域采样生成,采样数量由计数标注决定。为进一步增强模型的空间感知能力,引入自监督对比空间正则化,促使密集区域特征相似而与背景差异显著。实验表明,该方法在跨域适应场景下显著优于现有方法,在多个数据集上的半监督设置中达到最新水平。额外分析验证了各组件的有效性,证明Count2Density能从计数信息中有效恢复空间分布,实现子区域精确计数。
原文摘要 · Abstract (English)
Crowd density estimation is a well-known computer vision task aimed at estimating the density distribution of people in an image. The main challenge in this domain is the reliance on fine-grained location-level annotations, (i.e. points placed on top of each individual) to train deep networks. Collecting such detailed annotations is both tedious, time-consuming, and poses a significant barrier to scalability for real-world applications. To alleviate this burden, we present Count2Density: a novel pipeline designed to predict meaningful density maps containing quantitative spatial information using only count-level annotations (i.e., total number of people) during training. To achieve this, Count2Density generates pseudo-density maps leveraging past predictions stored in a Historical Map Bank, thereby reducing confirmation bias. This bank is initialised using an unsupervised saliency estimator to provide an initial spatial prior and is iteratively updated with an EMA of predicted density maps. These pseudo-density maps are obtained by sampling locations from estimated crowd areas using a hypergeometric distribution, with the number of samplings determined by the count-level annotations. To further enhance the spatial awareness of the model, we add a self-supervised contrastive spatial regulariser to encourage similar feature representations within crowded regions while maximising dissimilarity with background regions. Experimental results demonstrate that our approach significantly outperforms cross-domain adaptation methods and achieves better results than recent state-of-the-art approaches in semi-supervised settings across several datasets. Additional analyses validate the effectiveness of each individual component of our pipeline, confirming the ability of Count2Density to effectively retrieve spatial information from count-level annotations and enabling accurate subregion counting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。