通过排序多视角融合模型,用少量标注数据提升人群计数精度。
Semi-Supervised Multi-View Crowd Counting by Ranking Multi-View Fusion Models
- 用视角数量不同模型的预测或不确定性排序约束训练
- 在有限标注数据下,相比其他半监督方法误差更低
- 适合标注成本高、视角多但数据少的场景
多视角人群计数旨在解决大范围场景中严重遮挡问题。然而,由于多视角图像采集和标注困难,现有数据集中的多视角帧和场景数量有限。为缓解数据不足问题,本文提出两种基于多视角融合模型排序的半监督方法:第一种(基础模型)根据输入视角数量对模型预测结果进行排序,即视角越少的预测值不能超过视角越多的结果;第二种基于模型不确定性,利用预测误差指导排序,要求视角越多的模型不确定性不能更高。这些约束以半监督方式引入训练过程,有效利用有限标注数据。实验表明,所提方法在多视角计数任务中优于其他半监督方法。
原文摘要 · Abstract (English)
Multi-view crowd counting has been proposed to deal with the severe occlusion issue of crowd counting in large and wide scenes. However, due to the difficulty of collecting and annotating multi-view images, the datasets for multi-view counting have a limited number of multi-view frames and scenes. To solve the problem of limited data, one approach is to collect synthetic data to bypass the annotating step, while another is to propose semi- or weakly-supervised or unsupervised methods that demand less multi-view data. In this paper, we propose two semi-supervised multi-view crowd counting frameworks by ranking the multi-view fusion models of different numbers of input views, in terms of the model predictions or the model uncertainties. Specifically, for the first method (vanilla model), we rank the multi-view fusion models' prediction results of different numbers of camera-view inputs, namely, the model's predictions with fewer camera views shall not be larger than the predictions with more camera views. For the second method, we rank the estimated model uncertainties of the multi-view fusion models with a variable number of view inputs, guided by the multi-view fusion models' prediction errors, namely, the model uncertainties with more camera views shall not be larger than those with fewer camera views. These constraints are introduced into the model training in a semi-supervised fashion for multi-view counting with limited labeled data. The experiments demonstrate the advantages of the proposed multi-view model ranking methods compared with other semi-supervised counting methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。