提出主动选视图方法,用少标注实现跨场景人群计数与定位
Active View Selection for Scene-level Multi-view Crowd Counting and Localization with Limited Labeling Budget
- 基于视角与场景几何独立选视图,再联合标注与任务优化
- 仅需少量标注即在跨场景测试中超越现有方法
- 适合标注预算有限的实地部署场景
多视角人群计数与定位通过融合多视角输入来估计地面上的人群数量或位置。现有方法主要关注输入视角中人群的准确预测,忽略了如何选择‘最佳’摄像头视角以全面感知场景中的所有人群。此外,现有视图选择方法需要大量带标签的视图和图像,且缺乏跨场景能力,限制了应用范围。因此,本文研究在跨场景设置下、以有限标注预算实现更优场景级多视角人群计数与定位的视图选择问题。我们首先提出独立视图选择方法(IVS),在选视图策略中考虑视角与场景几何,并独立进行视图选择、标注与下游任务。基于IVS,进一步提出主动视图选择方法(AVS),联合执行视图选择、标注与下游任务。在AVS中,主动选择标注视图,同时考虑视角/场景几何及下游模型预测结果。在多视角计数与定位任务上的实验表明,所提出的主动视图选择方法(AVS)具有跨场景适应性与低标注需求优势,性能优于现有方法,应用场景更广。
原文摘要 · Abstract (English)
Multi-view crowd counting and localization fuse the input multi-views for estimating the crowd number or locations on the ground. Existing methods mainly focus on accurately predicting on the crowd shown in the input views, which neglects the problem of choosing the `best' camera views to perceive all crowds well in the scene. Besides, existing view selection methods require massive labeled views and images, and lack the ability for cross-scene settings, reducing their application scenarios. Thus, in this paper, we study the view selection issue for better scene-level multi-view crowd counting and localization results with cross-scene ability and limited label demand, instead of input-view-level results. We first propose an independent view selection method (IVS) that considers view and scene geometries in the view selection strategy and conducts the view selection, labeling, and downstream tasks independently. Based on IVS, we also put forward an active view selection method (AVS) that jointly conducts the view selection, labeling, and downstream tasks. In AVS, we actively select the labeled views and consider both the view/scene geometries and the predictions of the downstream task models in the view selection process. Experiments on multi-view counting and localization tasks demonstrate the cross-scene and the limited label demand advantages of the proposed active view selection method (AVS), outperforming existing methods and with wider application scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。