arXiv:2604.01742cs.CV2026-04

从点标注生成密集人群实例分割掩码,提升计数精度

Dense Point-to-Mask Optimization with Reinforced Point Selection for Crowd Instance Segmentation

  • 结合SAM与最近邻排斥圈约束,从点标注生成密集掩码
  • 在四个数据集上实现顶尖人群实例分割性能,计数准确率显著提升
  • 适合需要高精度人群分析的安防与交通场景

人群实例分割在监控与交通等领域具有重要意义。当前人群数据集多采用点标注,而区域标注(如边界框)稀少且不准确。通过分割获得的掩码有助于提升区域标注精度,并解决个体坐标与密度图之间的对应关系。然而,直接应用主流大模型如SAM在密集人群中效果不佳。为此,本文提出密集点到掩码优化(DPMO),将SAM与最近邻排斥圈(NNEC)约束结合,从点标注生成密集实例分割掩码。利用DPMO与人工修正,我们从现有点标注中构建了传统人群数据集的掩码标注。为进一步预测密集人群实例分割,提出基于组相对策略优化(GRPO)训练的强化点选择(RPS)框架,从初始点预测采样中选出最优点。大量实验表明,在ShanghaiTech、UCF-QNRF、JHU-CROWD++和NWPU-Crowd数据集上达到当前最优性能。此外,设计由掩码监督的新损失函数,显著提升各类模型的计数表现,证明掩码标注对提升计数精度的关键作用。

原文摘要 · Abstract (English)

Crowd instance segmentation is a crucial task with a wide range of applications, including surveillance and transportation. Currently, point labels are common in crowd datasets, while region labels (e.g., boxes) are rare and inaccurate. The masks obtained through segmentation help to improve the accuracy of region labels and resolve the correspondence between individual location coordinates and crowd density maps. However, directly applying currently popular large foundation models such as SAM does not yield ideal results in dense crowds. To this end, we first propose Dense Point-to-Mask Optimization (DPMO), which integrates SAM with the Nearest Neighbor Exclusive Circle (NNEC) constraint to generate dense instance segmentation from point annotations. With DPMO and manual correction, we obtain mask annotations from the existing point annotations for traditional crowd datasets. Then, to predict instance segmentation in dense crowds, we propose a Reinforced Point Selection (RPS) framework trained with Group Relative Policy Optimization (GRPO), which selects the best predicted point from a sampling of the initial point prediction. Through extensive experiments, we achieve state-of-the-art crowd instance segmentation performance on ShanghaiTech, UCF-QNRF, JHU-CROWD++, and NWPU-Crowd datasets. Furthermore, we design new loss functions supervised by masks that boost counting performance across different models, demonstrating the significant role of mask annotations in enhancing counting accuracy.

人群分割实例分割点标注掩码优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。