提出新方法提升拥挤场景视频人流量计数精度
Crowded Video Individual Counting Informed by Social Grouping and Spatial-Temporal Displacement Priors
- 引入社会分组与时空位移先验,改进多人匹配机制
- 在武汉地铁数据集上误差降低38.12%,显著优于现有方法
- 适合研究密集人群计数与视频理解的科研人员
视频个体计数(VIC)旨在从视频中估计行人流量,超越了传统每帧行人计数。与视频人群计数(VCC)不同,VIC需识别跨帧共存行人,本质是对应问题。现有方法在地铁等高密度场景表现不佳。为此,我们构建了武汉地铁人群数据集WuhanMetroCrowd,涵盖稀疏到密集密度、短至长视频片段、慢速到快速流动、前后视角变化及轻度到重度遮挡。我们重新思考VIC本质,提出两个重要先验:社会分组先验(行人倾向于成群)和时空位移先验(个体不能瞬移)。前者促使采用隐式上下文生成器与一对多(O2M)匹配机制;后者用于设计位移先验注入器,强化匹配、特征提取与训练。二者共同构成新基准OMAN++。大量实验表明,OMAN++不仅在SenseCrowd、CroHD、MovingDroneCrowd上优于当前最优模型,更在拥挤场景中表现突出,在WuhanMetroCrowd上误差降低38.12%。代码、数据与预训练模型已开源。
原文摘要 · Abstract (English)
Video Individual Counting (VIC) is a recently introduced task aiming to estimate pedestrian flux from a video. It extends Video Crowd Counting (VCC) beyond the per-frame pedestrian count. In contrast to VCC that learns to count pedestrians across frames, VIC must identify co-existent pedestrians between frames, which turns out to be a correspondence problem. Existing VIC approaches, however, can underperform in congested scenes such as metro commuting. To address this, we build WuhanMetroCrowd, one of the first VIC datasets that characterize crowded, dynamic pedestrian flows. It features sparse-to-dense density levels, short-to-long video clips, slow-to-fast flow variations, front-to-back appearance changes, and light-to-heavy occlusions. To better adapt VIC approaches to crowds, we rethink the nature of VIC and recognize two informative priors: i) the social grouping prior that indicates pedestrians tend to gather in groups and ii) the spatial-temporal displacement prior that informs an individual cannot teleport physically. The former inspires us to relax the standard one-to-one (O2O) matching used by VIC to one-to-many (O2M) matching, implemented by an implicit context generator and a O2M matcher; the latter facilitates the design of a displacement prior injector, which strengthens not only O2M matching but also feature extraction and model training. These designs jointly form a novel and strong VIC baseline OMAN++. Extensive experiments show that OMAN++ not only outperforms state-of-the-art VIC baselines on the standard SenseCrowd, CroHD, and MovingDroneCrowd benchmarks, but also indicates a clear advantage in crowded scenes, with a 38.12% error reduction on our WuhanMetroCrowd dataset. Code, data, and pretrained models are available at https://github.com/tiny-smart/OMAN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。