arXiv:2508.00427cs.CVcs.AI2025-08ICCV被引 3

基于接触信息的多区域修复,让模型更真实地补全人物交互中的遮挡部分。

Contact-Aware Amodal Completion for Human-Object Interaction via Multi-Regional Inpainting

  • 分主次区域,利用人体拓扑和接触信息指导扩散模型修复
  • 在动态交互场景中显著提升补全形状与视觉细节的真实度
  • 无需真实接触标注,适合3D重建和新视角生成任务

视觉中的非可见部分补全对理解复杂的人物交互(HOI)至关重要。现有方法如预训练扩散模型在动态场景中常因缺乏对交互的理解而生成不合理结果。为此,本文提出一种结合物理先验与专用多区域修复的新方法。通过人体拓扑与接触信息定义两个区域:主要区域(遮挡物最可能所在)与次要区域(遮挡可能性较低)。在扩散模型中为不同区域设计定制化去噪策略,从而提升生成结果在形状与视觉细节上的准确性和真实性。实验表明,该方法在HOI场景中显著优于现有技术;且无需真实接触标注,具备强鲁棒性,适用于3D重建、新视角/姿态合成等任务。

原文摘要 · Abstract (English)

Amodal completion, which is the process of inferring the full appearance of objects despite partial occlusions, is crucial for understanding complex human-object interactions (HOI) in computer vision and robotics. Existing methods, such as those that use pre-trained diffusion models, often struggle to generate plausible completions in dynamic scenarios because they have a limited understanding of HOI. To solve this problem, we've developed a new approach that uses physical prior knowledge along with a specialized multi-regional inpainting technique designed for HOI. By incorporating physical constraints from human topology and contact information, we define two distinct regions: the primary region, where occluded object parts are most likely to be, and the secondary region, where occlusions are less probable. Our multi-regional inpainting method uses customized denoising strategies across these regions within a diffusion model. This improves the accuracy and realism of the generated completions in both their shape and visual detail. Our experimental results show that our approach significantly outperforms existing methods in HOI scenarios, moving machine perception closer to a more human-like understanding of dynamic environments. We also show that our pipeline is robust even without ground-truth contact annotations, which broadens its applicability to tasks like 3D reconstruction and novel view/pose synthesis.

图像补全人机交互扩散模型多区域修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。