arXiv:2603.09418cs.CV2026-03中稿 · CVPR被引 1

用因果干预提升全身姿态估计的合理性与鲁棒性

CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation

  • 通过因果干预模块消除视觉上下文干扰,生成不变特征
  • 在COCO-WholeBody上达67.0% AP,无需额外训练数据
  • 适合关注姿态合理性与数据效率的研究者

当前最先进的全身姿态估计算法在复杂场景中常产生解剖上不合理的预测。我们指出这一问题源于模型从视觉上下文中学习到的虚假相关性,并通过结构因果模型(SCM)形式化该现象:视觉上下文作为混杂因子,引入非因果后门路径,污染模型推理。为此,我们提出因果干预图姿态估计框架(CIGPose),以逼近视觉证据与姿态之间的真正因果效应。其核心为新型因果干预模块:首先通过预测不确定性识别受干扰的关键点表示,再以学习到的上下文无关标准嵌入替代之。这些去混杂嵌入由分层图神经网络处理,在局部与全局语义层面推理人体骨骼,强制解剖合理性。大量实验表明,CIGPose在COCO-WholeBody上达到新基准。特别地,CIGPose-x模型达67.0% AP,超越依赖额外训练数据的方法。结合额外的UBody数据集,性能进一步提升至67.5% AP,展现优异鲁棒性与数据效率。代码与模型已公开于https://github.com/53mins/CIGPose。

原文摘要 · Abstract (English)

State-of-the-art whole-body pose estimators often lack robustness, producing anatomically implausible predictions in challenging scenes. We posit this failure stems from spurious correlations learned from visual context, a problem we formalize using a Structural Causal Model (SCM). The SCM identifies visual context as a confounder that creates a non-causal backdoor path, corrupting the model's reasoning. We introduce the Causal Intervention Graph Pose (CIGPose) framework to address this by approximating the true causal effect between visual evidence and pose. The core of CIGPose is a novel Causal Intervention Module: it first identifies confounded keypoint representations via predictive uncertainty and then replaces them with learned, context-invariant canonical embeddings. These deconfounded embeddings are processed by a hierarchical graph neural network that reasons over the human skeleton at both local and global semantic levels to enforce anatomical plausibility. Extensive experiments show CIGPose achieves a new state-of-the-art on COCO-WholeBody. Notably, our CIGPose-x model achieves 67.0\% AP, surpassing prior methods that rely on extra training data. With the additional UBody dataset, CIGPose-x is further boosted to 67.5\% AP, demonstrating superior robustness and data efficiency. The codes and models are publicly available at https://github.com/53mins/CIGPose.

姿态估计因果推理图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。