解决单目人体重建中遮挡导致的模型不完整问题。
OAHuman: Occlusion-Aware 3D Human Reconstruction from Monocular Images
- 分离几何与纹理建模,避免遮挡区互相干扰。
- 在遮挡区域仍能恢复完整人体结构,细节更真实。
- 适合需要高精度人体重建的虚拟试衣、影视制作场景。
单目图像中的真实世界人体三维重建因周围物体、他人或图像截断导致的频繁遮挡而极具挑战。此类遮挡造成几何缺失和外观线索不可靠,严重降低重建模型的完整性与真实性。尽管近期神经隐式方法在干净输入下表现优异,但在遮挡条件下因形状与纹理建模耦合而表现不佳。本文提出OAHuman,一种显式解耦几何重建与纹理合成的遮挡感知框架,核心创新为解耦-感知范式,从根本上解决遮挡区域形状与纹理的交叉污染问题。该框架确保几何重建在遮挡区域仍受感知强化,不受纹理干扰;同时纹理合成仅基于可见区域学习,防止纹理错误传播至遮挡区。此解耦策略使OAHuman在遮挡丰富的基准上实现鲁棒且高保真的重建,在结构完整性、表面细节与纹理真实感方面显著优于现有方法。
原文摘要 · Abstract (English)
Monocular 3D human reconstruction in real-world scenarios remains highly challenging due to frequent occlusions from surrounding objects, people, or image truncation. Such occlusions lead to missing geometry and unreliable appearance cues, severely degrading the completeness and realism of reconstructed human models. Although recent neural implicit methods achieve impressive results on clean inputs, they struggle under occlusion due to entangled modeling of shape and texture. In this paper, we propose OAHuman, an occlusion-aware framework that explicitly decouples geometry reconstruction and texture synthesis for robust 3D human modeling from a single RGB image. The core innovation lies in the decoupling-perception paradigm, which addresses the fundamental issue of geometry-texture cross-contamination in occluded regions. Our framework ensures that geometry reconstruction is perceptually reinforced even in occluded areas, isolating it from texture interference. In parallel, texture synthesis is learned exclusively from visible regions, preventing texture errors from being transferred to the occluded areas. This decoupling approach enables OAHuman to achieve robust and high-fidelity reconstruction under occlusion, which has been a long-standing challenge in the field. Extensive experiments on occlusion-rich benchmarks demonstrate that OAHuman achieves superior performance in terms of structural completeness, surface detail, and texture realism, significantly improving monocular 3D human reconstruction under occlusion conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。