腾讯推出3D生成新模型,可一键生成高精度带纹理的3D资产。
Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation
- 用扩散Transformer生成与条件图对齐的3D形状。
- 纹理生成支持高分辨率,适配自动生成或手工建模的网格。
- 提供易用平台,支持用户高效编辑甚至动画化3D模型。
我们提出Hunyuan3D 2.0,一个大规模3D生成系统,用于生成高分辨率带纹理的3D资产。该系统包含两个基础组件:基于可扩展流式扩散Transformer的形状生成模型Hunyuan3D-DiT,以及大规模纹理生成模型Hunyuan3D-Paint。前者旨在根据给定条件图像生成几何结构,为下游应用打下基础;后者利用强几何与扩散先验,为生成或手工制作的网格生成高质量、高分辨率的纹理贴图。此外,我们构建了通用且易用的生产平台Hunyuan3D-Studio,支持专业与非专业用户高效操作或动画化其3D网格。系统在几何细节、条件对齐度、纹理质量等方面均优于此前最先进模型(包括开源与闭源模型)。Hunyuan3D 2.0已公开发布,填补了开源3D社区中大规模生成模型的空白。代码与预训练权重可在https://github.com/Tencent/Hunyuan3D-2获取。
原文摘要 · Abstract (English)
We present Hunyuan3D 2.0, an advanced large-scale 3D synthesis system for generating high-resolution textured 3D assets. This system includes two foundation components: a large-scale shape generation model -- Hunyuan3D-DiT, and a large-scale texture synthesis model -- Hunyuan3D-Paint. The shape generative model, built on a scalable flow-based diffusion transformer, aims to create geometry that properly aligns with a given condition image, laying a solid foundation for downstream applications. The texture synthesis model, benefiting from strong geometric and diffusion priors, produces high-resolution and vibrant texture maps for either generated or hand-crafted meshes. Furthermore, we build Hunyuan3D-Studio -- a versatile, user-friendly production platform that simplifies the re-creation process of 3D assets. It allows both professional and amateur users to manipulate or even animate their meshes efficiently. We systematically evaluate our models, showing that Hunyuan3D 2.0 outperforms previous state-of-the-art models, including the open-source models and closed-source models in geometry details, condition alignment, texture quality, and etc. Hunyuan3D 2.0 is publicly released in order to fill the gaps in the open-source 3D community for large-scale foundation generative models. The code and pre-trained weights of our models are available at: https://github.com/Tencent/Hunyuan3D-2
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。