arXiv:2603.20310cs.CVcs.GR2026-03中稿 · ICME 2026被引 1

基于人体姿态的鲁棒接触感知,提升交互系统对人-场景接触的识别能力。

GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems

  • 利用重构的人体网格作为骨架,结合双编码器先验进行接触推理。
  • 在五个数据集上同时提升接触预测与3D重建效果,尤其在遮挡下表现更优。
  • 适合做智能助行、康复分析等需要精准人-环境交互感知的应用。

单目顶点级人-场景接触预测是辅助监测、具身AI和康复分析等交互系统的基础能力。本文将该任务与单图像3D人体网格重建联合建模,利用重建的人体几何作为接触推理的框架。现有方法或忽视显式3D人体先验,或未直接优化遮挡与感知噪声下的鲁棒顶点级接触推断。为此,我们提出GraphiContact,一种姿态感知框架,通过两个预训练Transformer编码器传递互补人体先验,并在重构网格上预测逐顶点接触。为增强真实场景鲁棒性,进一步引入单图多推理不确定性(SIMU)训练策略,结合令牌级自适应路由,在训练中模拟遮挡与噪声观测,同时保持测试时单分支高效推理。在五个基准数据集上的实验表明,GraphiContact在接触预测与3D人体重建上均实现一致提升。代码基于GraphiContact方法,提供完整的3D人体重建与交互分析,将公开于https://github.com/Aveiro-Lin/GraphiContact。

原文摘要 · Abstract (English)

Monocular vertex-level human-scene contact prediction is a fundamental capability for interactive systems such as assistive monitoring, embodied AI, and rehabilitation analysis. In this work, we study this task jointly with single-image 3D human mesh reconstruction, using reconstructed body geometry as a scaffold for contact reasoning. Existing approaches either focus on contact prediction without sufficiently exploiting explicit 3D human priors, or emphasize pose/mesh reconstruction without directly optimizing robust vertex-level contact inference under occlusion and perceptual noise. To address this gap, we propose GraphiContact, a pose-aware framework that transfers complementary human priors from two pretrained Transformer encoders and predicts per-vertex human-scene contact on the reconstructed mesh. To improve robustness in real-world scenarios, we further introduce a Single-Image Multi-Infer Uncertainty (SIMU) training strategy with token-level adaptive routing, which simulates occlusion and noisy observations during training while preserving efficient single-branch inference at test time. Experiments on five benchmark datasets show that GraphiContact achieves consistent gains on both contact prediction and 3D human reconstruction. Our code, based on the GraphiContact method, provides comprehensive 3D human reconstruction and interaction analysis, and will be publicly available at https://github.com/Aveiro-Lin/GraphiContact.

接触感知3D人体重建交互系统鲁棒推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。