无需标定和密集标注,用人数直接训练多视角人群计数模型。
WSCF-MVCC: Weakly-supervised Calibration-free Multi-view Crowd Counting
- 用人群总数替代密度图作为监督信号,降低标注成本。
- 引入自监督排序损失,利用多尺度先验提升感知能力。
- 融合语义信息实现更精准的视角匹配,适合真实场景部署。
多视角人群计数能有效缓解单图计数中的遮挡问题。现有深度学习方法将不同摄像头图像投影到统一空间以生成地面密度图,但需大量昂贵的群体标注和相机标定。因此,无标定方法被提出,无需相机标定和场景级标注。然而,现有无标定方法仍需高成本的图像级人群标注来训练单视角计数模块。本文提出一种弱监督无标定多视角人群计数方法(WSCF-MVCC),直接使用人群总数作为单视角计数模块的监督信号,而非依赖标注构建的密度图。同时,采用基于多尺度先验的自监督排序损失,增强模型感知能力,无需额外标注。此外,模型利用语义信息实现更精确的视角匹配,从而提升场景级人群计数精度。在三个常用多视角计数数据集上,该方法在弱监督设置下优于当前最先进方法,表明其更适合实际部署。代码已开源:https://github.com/zqyq/Weakly-MVCC。
原文摘要 · Abstract (English)
Multi-view crowd counting can effectively mitigate occlusion issues that commonly arise in single-image crowd counting. Existing deep-learning multi-view crowd counting methods project different camera view images onto a common space to obtain ground-plane density maps, requiring abundant and costly crowd annotations and camera calibrations. Hence, calibration-free methods are proposed that do not require camera calibrations and scene-level crowd annotations. However, existing calibration-free methods still require expensive image-level crowd annotations for training the single-view counting module. Thus, in this paper, we propose a weakly-supervised calibration-free multi-view crowd counting method (WSCF-MVCC), directly using crowd count as supervision for the single-view counting module rather than density maps constructed from crowd annotations. Instead, a self-supervised ranking loss that leverages multi-scale priors is utilized to enhance the model's perceptual ability without additional annotation costs. What's more, the proposed model leverages semantic information to achieve a more accurate view matching and, consequently, a more precise scene-level crowd count estimation. The proposed method outperforms the state-of-the-art methods on three widely used multi-view counting datasets under weakly supervised settings, indicating that it is more suitable for practical deployment compared with calibrated methods. Code is released in https://github.com/zqyq/Weakly-MVCC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。