只优化可见身体区域,实现高精度3D虚拟人重建。
FlexiAvatar: Unified 3D Gaussian Human Avatars Under Arbitrary Body Visibility

- 仅对可见部位优化,避免不可见肢体带来的伪影。
- 在多个数据集上平均提升3%的PSNR,重建更清晰。
- 适合部分可见视频输入,运行更快内存更省。
从单目视频重建可动画化的3D人体形象是计算机视觉中的基础问题,广泛应用于AR/VR与数字内容创作。现有方法通常将参数化人体模型与神经渲染或3D高斯溅射耦合,并从短视频中联合优化所有身体区域,常导致可见区域质量下降。为此,我们提出FlexiAvatar,一种统一框架,显式仅优化可见身体区域,有效消除因未观测肢体引发的伪影。方法结合抗遮挡的SMPL-X追踪与局部残差精修,捕捉高频几何与外观细节;对于完全未见区域(如背面),采用基于扩散的方法生成与观测外观一致的纹理。在全身体(NeuMan、ZJU-MoCap、WildAvatar)、上半身/半身(访谈片段)及仅头部(INSTA)输入上的实验表明,FlexiAvatar在各数据集上均保持更高重建质量,平均PSNR提升约3%。此外,通过限制优化范围,显著减少需优化与渲染的高斯数量,在部分可见场景下降低运行时与内存开销。
原文摘要 · Abstract (English)
Reconstructing animatable 3D human avatars from monocular video is a fundamental problem in computer vision with broad applications in AR/VR and digital content creation. Existing approaches typically couple parametric body models with neural rendering or 3D Gaussian splatting and optimize all body regions jointly from short videos, which often degrades fidelity in the visible areas. To overcome this limitation, we introduce FlexiAvatar, a unified framework that explicitly optimizes only the visible body regions, effectively eliminating artifacts arising from unobserved limbs. Our method integrates occlusion-robust SMPL-X tracking with part-specific residual refinement to capture high-frequency geometric and appearance details. To complete entirely unseen regions (e.g., back views), we leverage a diffusion-based approach to generate texture consistent with the observed appearance. Experiments on full-body (NeuMan, ZJU-MoCap, WildAvatar), upper/half-body (talk-show clips), and head-only (INSTA) inputs show that FlexiAvatar delivers consistently higher reconstruction quality, outperforming state-of-the-art methods by an average PSNR improvement of approximately 3% across datasets. Finally, by restricting optimization to observed regions, our method reduces the effective number of Gaussians that must be optimized and rendered, leading to reduced runtime and memory overhead in partial-visibility scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。