针对无人机拍摄的密集人群,提出更精准的计数与跟踪方法。
Video Individual Counting and Tracking from Moving Drones: A Benchmark and Methods
- 通过分组描述符关联建立跨帧对应,分解全局密度图。
- 计数误差降低47.4%,跟踪准确率提升64.6%。
- 适合复杂空拍场景下密集人群分析,尤其无人机应用。
在大规模场景中对密集人群进行计数与跟踪是一项高度实用但极具挑战的任务。现有方法多依赖固定摄像头数据集,覆盖范围有限,难以应对大范围空拍场景。为此,我们构建了目前最大的视频级数据集 MovingDroneCrowd++,专用于快速移动无人机拍摄的密集人群计数与跟踪,涵盖不同飞行高度、视角和光照条件。然而,现有方法在这些挑战性空中条件下仍表现不佳。为此,我们提出 GD3A(基于分组描述符关联的全局密度图分解),首先通过自适应桶评分的最优传输建立行人描述符间的像素级跨帧对应,再采用分组关联将全局密度图分解为共享、流入与流出密度图。我们还提出 DVTrack(描述符投票跟踪),将描述符级匹配转化为实例级关联,利用每个行人的多描述符分组匹配结果,而非单一向量。由于组内匹配误差不影响最终结果,方法在密集人群和复杂空中条件下更具鲁棒性。实验表明,在移动无人机视频上,我们的方法在人群计数与跟踪上均取得显著提升,计数误差降低47.4%,跟踪准确率提高64.6%。代码、数据集与预训练模型已开源。
原文摘要 · Abstract (English)
Counting and tracking dense crowds in large-scale scenes is a highly practical yet challenging problem. Existing methods mostly rely on fixed-camera datasets with limited scene coverage, making them inadequate for crowd analysis in large-scale scenes. To bridge this gap, we introduce MovingDroneCrowd++, the largest video-level dataset dedicated to dense crowd counting and tracking with fast-moving drones, captured under diverse flight altitudes, camera angles, and illumination conditions. Existing methods, however, still fail to achieve satisfactory video individual counting or tracking performance under these challenging aerial conditions. To this end, we propose GD3A (Global Density map Decomposition via group-wise Descriptor Association), a video individual counting method that first establishes pixel-level correspondences between pedestrian descriptors across frames via optimal transport with an adaptive dustbin score. Then, group-wise association is adopted to guide the decomposition of the global density map into shared, inflow, and outflow density maps. We further introduce a pedestrian tracking method, DVTrack (Descriptor Voting Track), which converts descriptor-level matching into instance-level association through descriptor voting. Our methods rely on the association results of group-wise multiple descriptors for each pedestrian rather than a single vector. Since intra-group matching errors do not affect the final counting and tracking results, our methods are more robust in dense crowds and challenging aerial conditions. Experiments show that our methods achieve substantial gains in both crowd counting and tracking on moving-drone videos with dense crowds and complex motions, reducing counting error by 47.4% and improving tracking accuracy by 64.6%. Code, dataset, and pretrained models are available at https://github.com/fyw1999/MovingDroneCrowd.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。