生成可编辑的3D角色,支持高保真与语义解耦
StdGEN++: A Comprehensive System for Semantic-Decomposed 3D Character Generation
- 双分支模型联合重建几何、颜色和组件语义
- 实现高分辨率网格生成,内存占用降低显著
- 支持非破坏性编辑与眼球追踪等高级应用
我们提出StdGEN++,一个全新的综合系统,用于从多样化输入生成高保真、语义解耦的3D角色。现有3D生成方法常产生整体式网格,缺乏游戏与动画工业管线所需的结构灵活性。为此,StdGEN++基于双分支语义感知大重建模型(Dual-Branch S-LRM),以前馈方式联合重建几何、颜色及每组件语义。为实现生产级保真度,我们引入一种兼容混合隐式场的语义表面提取形式,通过粗到细的提案方案加速,大幅降低内存开销并支持高分辨率网格生成。此外,提出基于视频扩散的纹理解耦模块,将外观分解为可编辑层(如分离虹膜与皮肤),解决面部区域的语义混淆问题。实验表明,StdGEN++在几何精度与语义解耦方面显著优于现有方法。关键的是,结构独立性解锁了非破坏性编辑、物理合规动画与注视追踪等下游能力,成为自动化角色资产生成的可靠解决方案。
原文摘要 · Abstract (English)
We present StdGEN++, a novel and comprehensive system for generating high-fidelity, semantically decomposed 3D characters from diverse inputs. Existing 3D generative methods often produce monolithic meshes that lack the structural flexibility required by industrial pipelines in gaming and animation. Addressing this gap, StdGEN++ is built upon a Dual-branch Semantic-aware Large Reconstruction Model (Dual-Branch S-LRM), which jointly reconstructs geometry, color, and per-component semantics in a feed-forward manner. To achieve production-level fidelity, we introduce a novel semantic surface extraction formalism compatible with hybrid implicit fields. This mechanism is accelerated by a coarse-to-fine proposal scheme, which significantly reduces memory footprint and enables high-resolution mesh generation. Furthermore, we propose a video-diffusion-based texture decomposition module that disentangles appearance into editable layers (e.g., separated iris and skin), resolving semantic confusion in facial regions. Experiments demonstrate that StdGEN++ achieves state-of-the-art performance, significantly outperforming existing methods in geometric accuracy and semantic disentanglement. Crucially, the resulting structural independence unlocks advanced downstream capabilities, including non-destructive editing, physics-compliant animation, and gaze tracking, making it a robust solution for automated character asset production.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。