30秒生成可部署的高质量3D模型,支持实时交互与移动端使用。
AssetGen: Deployable 3D Asset Generation at Interactive Speed

- 分步优化的向量集框架,实现GPU加速的网格简化与法线烘焙。
- 30秒内完成高精度3D建模,14秒内闪速生成预览级结果。
- 专为交互式创作设计,适合游戏、VR及AI辅助建模场景。
尽管3D生成技术快速发展,但多数研究聚焦于高分辨率输出,忽视了用户体验与可部署性。我们提出AssetGen,一种以用户交互与部署能力为核心的3D生成系统。仅需一张参考图像,30秒内即可生成带烘焙法线、颜色贴图和可控面数的高质量网格,适用于实时渲染,包括移动端。其Flash变体将延迟降至14秒,支持交互式与代理生成循环。系统采用粗到精的VecSet框架,在GPU上实现网格简化、清理与法线烘焙,并进行快速并行UV展开;纹理通过多视角生成后经反投影与3D补全。通过模型蒸馏、内核优化与流水线并行化协同加速全流程。我们引入多项自动化与盲测人类评估,证明其在30秒内视觉质量媲美主流商业方案,15秒内达到预览级效果。最终系统支持交互式AI辅助3D内容创建。
原文摘要 · Abstract (English)
While 3D generation is progressing rapidly, recent work has often focused on obtaining high-resolution assets, leaving user experience and deployability as afterthoughts. We present AssetGen, a 3D generator that focuses instead on these two aspects. Given one reference image, in 30 seconds it produces a high-quality mesh with baked normals, a color texture, and a controlled polygon budget suitable for real-time rendering, including mobile use cases. The AssetGen Flash variant further reduces latency to 14 seconds for interactive and agentic creation loops. Our model generates the object geometry with a coarse-to-refine VecSet framework, which implements mesh simplification, cleaning, and normal baking on the GPU, and a fast parallel UV unwrapping. It then generates textures in a multi-view fashion, followed by backprojection and 3D inpainting. Model distillation, kernel optimization, and pipeline parallelization are co-designed to accelerate the system end-to-end. We introduce numerous automated and blind human evaluations and demonstrate competitive visual quality against leading commercial solutions in 30 seconds and preview-quality results in less than 15 seconds. The final result is a system that supports AI-assisted, deployable 3D content creation in interactive workflows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。