用密度信息增强拥挤场景下的目标检测,2D/3D通用。
CrowdQuery: Density-Guided Query Module for Enhanced 2D and 3D Detection in Crowded Scenes
- 通过边界框尺寸扩展密度定义,生成嵌入式密度图。
- 在STCrowd上2D/3D检测均显著提升,优于多数先进方法。
- 可无缝集成至主流检测器,适合复杂人群场景应用。
本文提出一种端到端拥挤场景检测新方法——CrowdQuery(CQ),其核心为密度引导查询模块。该模块预测并嵌入物体密度图,结合个体边界框尺寸扩展传统密度定义,将密度信息系统性融入解码器。通过密度引导查询,显著提升拥挤场景下2D与3D目标检测性能。该方法无需额外数据,适用于通用的2D与3D Transformer检测器,我们构建了CQ2D与CQ3D架构。在STCrowd数据集上的实验表明,相比基线模型有显著提升,超越多数现有方法。进一步集成至先进人群检测器后,在挑战性数据集CrowdHuman上仍能持续增益,验证其泛化能力。代码已开源:https://github.com/mdaehl/CrowdQuery。
原文摘要 · Abstract (English)
This paper introduces a novel method for end-to-end crowd detection that leverages object density information to enhance existing transformer-based detectors. We present CrowdQuery (CQ), whose core component is our CQ module that predicts and subsequently embeds an object density map. The embedded density information is then systematically integrated into the decoder. Existing density map definitions typically depend on head positions or object-based spatial statistics. Our method extends these definitions to include individual bounding box dimensions. By incorporating density information into object queries, our method utilizes density-guided queries to improve detection in crowded scenes. CQ is universally applicable to both 2D and 3D detection without requiring additional data. Consequently, we are the first to design a method that effectively bridges 2D and 3D detection in crowded environments. We demonstrate the integration of CQ into both a general 2D and 3D transformer-based object detector, introducing the architectures CQ2D and CQ3D. CQ is not limited to the specific transformer models we selected. Experiments on the STCrowd dataset for both 2D and 3D domains show significant performance improvements compared to the base models, outperforming most state-of-the-art methods. When integrated into a state-of-the-art crowd detector, CQ can further improve performance on the challenging CrowdHuman dataset, demonstrating its generalizability. The code is released at https://github.com/mdaehl/CrowdQuery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。