arXiv:2409.01726cs.CV2024-09ECCV被引 12

用马氏距离优化多视角人群定位,提升密集场景精度。

Mahalanobis Distance-based Multi-view Optimal Transport for Multi-view Crowd Localization

  • 引入马氏距离替代欧氏距离,使代价函数具方向性椭圆等高线。
  • 根据相机距离调整惩罚,远距离误判受更重惩罚,提升定位准确性。
  • 融合多视角信息,在复杂场景下优于传统密度图或欧式最优传输方法。

多视角人群定位旨在预测场景中所有人员的地面位置。现有方法通常先估计地面平面的人群密度图,再从中推断位置。然而,在拥挤区域,密度图的局部峰值易被平滑,导致定位模糊。为缓解密度图监督的不足,单图像人群定位已采用基于最优传输的点级监督,但多视角场景尚未探索。本文提出一种新型马氏距离驱动的多视角最优传输(M-MVOT)损失,专为多视角人群定位设计。首先,将基于欧氏距离的传输代价替换为马氏距离,其代价函数定义了由视角射线方向引导的椭圆等高线;其次,利用各视角中目标与相机的距离进一步调整传输代价,使远离相机的错误预测受到更强惩罚;最后,通过计算每个真实点到最近相机的最优传输代价,实现多视角输入在模型损失中的统一融合。实验表明,该方法在多个多视角人群定位数据集上优于基于密度图或常规欧氏距离的最优传输损失。

原文摘要 · Abstract (English)

Multi-view crowd localization predicts the ground locations of all people in the scene. Typical methods usually estimate the crowd density maps on the ground plane first, and then obtain the crowd locations. However, the performance of existing methods is limited by the ambiguity of the density maps in crowded areas, where local peaks can be smoothed away. To mitigate the weakness of density map supervision, optimal transport-based point supervision methods have been proposed in the single-image crowd localization tasks, but have not been explored for multi-view crowd localization yet. Thus, in this paper, we propose a novel Mahalanobis distance-based multi-view optimal transport (M-MVOT) loss specifically designed for multi-view crowd localization. First, we replace the Euclidean-based transport cost with the Mahalanobis distance, which defines elliptical iso-contours in the cost function whose long-axis and short-axis directions are guided by the view ray direction. Second, the object-to-camera distance in each view is used to adjust the optimal transport cost of each location further, where the wrong predictions far away from the camera are more heavily penalized. Finally, we propose a strategy to consider all the input camera views in the model loss (M-MVOT) by computing the optimal transport cost for each ground-truth point based on its closest camera. Experiments demonstrate the advantage of the proposed method over density map-based or common Euclidean distance-based optimal transport loss on several multi-view crowd localization datasets. Project page: https://vcc.tech/research/2024/MVOT.

人群定位最优传输多视角马氏距离

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。