arXiv:2503.08367cs.CV2025-03NeurIPS被引 3

提出新任务与数据集,用智能导航实现复杂人群精准计数。

Embodied Crowd Counting

  • 设计可交互仿真环境,生成大规模真实分布人群。
  • 零样本导航方法实现精准计数,兼顾精度与探索成本。
  • 适合研究视觉导航与大规模人群分析的学者参考。

遮挡是人群计数中的核心挑战。现有数据驱动方法受限于被动摄像头采集的数据,难以充分感知环境。近期具身导航方法在交互场景中展现出高精度目标检测潜力,因其采用主动相机设置,有望解决人群计数的根本问题。然而,多数现有方法针对室内场景,对大规模复杂对象分布(如密集人群)性能未知;且主流具身导航数据集规模小、物体数量有限,难以用于密集人群分析。为此,本文提出新任务:具身人群计数(ECC),并构建交互式仿真器与数据集ECCD,支持大规模场景与大量物体。引入近似真实人群分布的先验概率生成人群。进一步提出零样本导航方法ZECC,包含基于多模态大模型的粗到精导航机制,支持主动垂直方向探索,并采用法向量基人群分布分析方法实现精细计数。实验表明,该方法在计数精度与导航成本间取得最佳平衡。

原文摘要 · Abstract (English)

Occlusion is one of the fundamental challenges in crowd counting. In the community, various data-driven approaches have been developed to address this issue, yet their effectiveness is limited. This is mainly because most existing crowd counting datasets on which the methods are trained are based on passive cameras, restricting their ability to fully sense the environment. Recently, embodied navigation methods have shown significant potential in precise object detection in interactive scenes. These methods incorporate active camera settings, holding promise in addressing the fundamental issues in crowd counting. However, most existing methods are designed for indoor navigation, showing unknown performance in analyzing complex object distribution in large scale scenes, such as crowds. Besides, most existing embodied navigation datasets are indoor scenes with limited scale and object quantity, preventing them from being introduced into dense crowd analysis. Based on this, a novel task, Embodied Crowd Counting (ECC), is proposed. We first build up an interactive simulator, Embodied Crowd Counting Dataset (ECCD), which enables large scale scenes and large object quantity. A prior probability distribution that approximates realistic crowd distribution is introduced to generate crowds. Then, a zero-shot navigation method (ZECC) is proposed. This method contains a MLLM driven coarse-to-fine navigation mechanism, enabling active Z-axis exploration, and a normal-line-based crowd distribution analysis method for fine counting. Experimental results against baselines show that the proposed method achieves the best trade-off between counting accuracy and navigation cost.

具身智能人群计数导航仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。