用概率分布建模多人3D人体姿态,更精准处理模糊与不确定性。
CondiMen: Conditional Multi-Person Mesh Recovery
- 采用贝叶斯网络输出联合概率分布,捕捉姿态与体型的关联性
- 在多个数据集上表现优于或媲美当前最佳方法,且能有效利用额外信息
- 适合实时应用,可结合多视角或先验知识提升精度
多人人体网格恢复(HMR)旨在从输入图像中检测所有人,并为每个人预测其身体形状、姿态和三维位置。现有主流方法依赖神经网络对每个检测到的人仅输出单一预测。本文提出CondiMen,通过贝叶斯网络输出一个联合参数化概率分布,涵盖可能的姿态、身体形状、内在属性及相机距离。该方法优势在于:首先,概率分布可处理任务固有的模糊性,如人大小与距离相机远近的不确定性,或3D投影至2D时的信息丢失;其次,输出分布可融合额外信息(如已知相机参数、身体形状先验或多视角观测),生成更优预测;第三,可高效提取最可能的预测结果,适合实时应用。实验表明,本模型在性能上达到或超越当前最佳水平,能准确捕捉姿态估计中的不确定性与相关性,并可在测试阶段利用多视角一致性或体形先验信息。CondiMen以恰当方式建模了模糊性,恰到好处地利用了现有信息。
原文摘要 · Abstract (English)
Multi-person human mesh recovery (HMR) consists in detecting all individuals in a given input image, and predicting the body shape, pose, and 3D location for each detected person. The dominant approaches to this task rely on neural networks trained to output a single prediction for each detected individual. In contrast, we propose CondiMen, a method that outputs a joint parametric distribution over likely poses, body shapes, intrinsics and distances to the camera, using a Bayesian network. This approach offers several advantages. First, a probability distribution can handle some inherent ambiguities of this task -- such as the uncertainty between a person's size and their distance to the camera, or simply the loss of information when projecting 3D data onto the 2D image plane. Second, the output distribution can be combined with additional information to produce better predictions, by using e.g. known camera or body shape parameters, or by exploiting multi-view observations. Third, one can efficiently extract the most likely predictions from the output distribution, making our proposed approach suitable for real-time applications. Empirically we find that our model i) achieves performance on par with or better than the state-of-the-art, ii) captures uncertainties and correlations inherent in pose estimation and iii) can exploit additional information at test time, such as multi-view consistency or body shape priors. CondiMen spices up the modeling of ambiguity, using just the right ingredients on hand.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。