为3D手部姿态估计引入可学习的不确定性建模,提升精度与可靠性。
Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimation
- 用单层线性网络捕捉手关节间的内在相关性。
- 在多个数据集上显著降低姿态估计误差,提升置信度准确性。
- 可作为插件模块适配现有模型,适合需要可靠预测的场景。
3D手部姿态估计是理解人类手部行为的基础任务,但因手部运动复杂、自相似性强及频繁遮挡而难以准确实现。本文针对现有方法在估计数据不确定性(aleatoric uncertainty)和缺乏关节相关性建模两方面的不足,提出一种新的不确定性建模框架。通过将手关节输出空间形式化为概率分布,利用单层线性网络捕获关节间的内在相关性,实现高效且精准的相关性建模。该参数化方式可作为任务头模块,灵活集成至现有模型中。实验表明,所提方法在多种基准数据集上均优于现有方法,在保持高精度的同时,显著提升了姿态估计的不确定性建模能力。
原文摘要 · Abstract (English)
3D hand pose estimation is a fundamental task in understanding human hands. However, accurately estimating 3D hand poses remains challenging due to the complex movement of hands, self-similarity, and frequent occlusions. In this work, we address two limitations: the inability of existing 3D hand pose estimation methods to estimate aleatoric (data) uncertainty, and the lack of uncertainty modeling that incorporates joint correlation knowledge, which has not been thoroughly investigated. To this end, we introduce aleatoric uncertainty modeling into the 3D hand pose estimation framework, aiming to achieve a better trade-off between modeling joint correlations and computational efficiency. We propose a novel parameterization that leverages a single linear layer to capture intrinsic correlations among hand joints. This is enabled by formulating the hand joint output space as a probabilistic distribution, allowing the linear layer to capture joint correlations. Our proposed parameterization is used as a task head layer, and can be applied as an add-on module on top of the existing models. Our experiments demonstrate that our parameterization for uncertainty modeling outperforms existing approaches. Furthermore, the 3D hand pose estimation model equipped with our uncertainty head achieves favorable accuracy in 3D hand pose estimation while introducing new uncertainty modeling capability to the model. The project page is available at https://hand-uncertainty.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。