用区域监督替代点监督,减少标注成本并提升密集人群计数效果
Point-to-Region Loss for Semi-Supervised Point-Based Crowd Counting
- 提出点到区域(P2R)监督机制,取代传统点对点方式
- 仅需少量标注样本,结合大量伪标签训练,计数准确率提升显著
- 适合数据标注昂贵的密集人群场景,如安防与交通监控
基于点检测的人群计数方法通过点对点(P2P)监督训练计数器,在定位和计数上表现优异,但面临标注成本高的问题:单个密集人群样本需标注数百至数千个点。本文将点基方法引入基于伪标签的半监督框架,仅用少量标注样本配合大量伪标签数据即可训练计数器。然而,训练中发现伪标签置信度无法通过P2P传播至背景像素。为此,我们设计点特定激活图(PSAM)分析问题,发现未标记数据损失导致特征图过度激活,使解码器误将过激活区域识别为行人。为缓解此问题,提出点到区域(P2R)监督方案,以局部区域代替点进行监督,使区域内像素共享对应伪点置信度。实验在半监督计数与无监督域适应任务中均验证了优势,证明P2R可有效解决PSAM揭示的问题。代码已开源。
原文摘要 · Abstract (English)
Point detection has been developed to locate pedestrians in crowded scenes by training a counter through a point-to-point (P2P) supervision scheme. Despite its excellent localization and counting performance, training a point-based counter still faces challenges concerning annotation labor: hundreds to thousands of points are required to annotate a single sample capturing a dense crowd. In this paper, we integrate point-based methods into a semi-supervised counting framework based on pseudo-labeling, enabling the training of a counter with only a few annotated samples supplemented by a large volume of pseudo-labeled data. However, during implementation, the training encounters issues as the confidence for pseudo-labels fails to be propagated to background pixels via the P2P. To tackle this challenge, we devise a point-specific activation map (PSAM) to visually interpret the phenomena occurring during the ill-posed training. Observations from the PSAM suggest that the feature map is excessively activated by the loss for unlabeled data, causing the decoder to misinterpret these over-activations as pedestrians. To mitigate this issue, we propose a point-to-region (P2R) scheme to substitute P2P, which segments out local regions rather than detects a point corresponding to a pedestrian for supervision. Consequently, pixels in the local region can share the same confidence with the corresponding pseudo points. Experimental results in both semi-supervised counting and unsupervised domain adaptation highlight the advantages of our method, illustrating P2R can resolve issues identified in PSAM. The code is available at https://github.com/Elin24/P2RLoss.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。