arXiv:2607.00273cs.CV2026-07

MVDGC联合优化3D鸟瞰图与2D图像视图中的行人检测,提升遮挡场景下的定位精度。

MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints

论文配图:MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints
图 1 · 摘自论文原文
  • 使用3D圆柱查询统一建模鸟瞰图与图像视图的几何关系
  • 在密集人群区域实现更精确的行人位置定位,避免投影失真
  • 适合需要多视角行人检测的自动驾驶与监控系统

多视角行人检测的核心挑战在于如何有效融合不同视角的视觉特征以实现鲁棒的遮挡推理。现有方法通常先将图像特征投影到鸟瞰图(BEV)平面进行地面定位,但透视变换导致严重失真,破坏空间结构,降低特征质量,尤其在高密度区域影响点定位准确性。同时,BEV点与图像框间的强关联未被充分利用。尽管多视角2D检测具有一致性约束潜力,却常被视为辅助信号而非与主任务联合优化。本文提出MVDGC,一个统一框架,联合估计鸟瞰图平面与图像视图中的行人位置。该方法采用稀疏的3D圆柱查询,融合两种视角的几何上下文,施加双重空间约束。每个行人被建模为垂直圆柱,中心位于鸟瞰图平面,其投影在图像中形成矩形框。这些查询作为形状锚点,通过相机投影直接从完整图像特征中提取2D特征,消除投影失真。3D圆柱查询将鸟瞰图与图像视图定位统一为单一任务:3D圆柱的位置与形状优化。代码已开源。

原文摘要 · Abstract (English)

The core challenge in multi-view pedestrian detection (MVPD) lies in effective aggregation of visual features from different viewpoints for robust occlusion reasoning. Recent approaches have addressed this by first projecting image-view features onto a Bird's Eye View (BEV) map, where ground localization is then performed. Despite impressive performance, the perspective transformation induces severe distortion, causing spatial structure break and degrading the quality of object feature extraction. The blurred and ambiguous features hinder accurate BEV point localization, especially in densely populated regions. Moreover, the strong mutual relationship between the BEV ground point and image bounding boxes is not capitalized on. Although multi-view consistency of 2D detections can serve as a powerful constraint in BEV space, these detections are commonly treated as auxiliary signals rather than being jointly optimized with the primary task.In this work, we propose \textbf{MVDGC}, a unified framework that \emph{jointly estimates pedestrian locations on the BEV plane and 2D bounding boxes in image views}. MVDGC employs a \emph{sparse set of 3D cylindrical queries} that embraces geometric context across both BEV and image views, enforcing dual spatial constraints for precise localization. Specifically, the geometric constraints is established by modeling each pedestrian as a vertical cylinder whose center lies on the BEV plane and whose projection casts a rectangular box in the image views. These queries function as shape anchors that directly extract 2D features from the intact image-view features using camera projection, eliminating projection-induced distortions. The 3D cylindrical query enables the unification of BEV and ImV localization into a single task: 3D cylinder position and shape refinement. Code is available at: https://github.com/UARK-AICV/MVDGC

多视角检测鸟瞰图行人检测几何约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。