用扩散模型同时生成地形高度图和纹理，保持二者关联性。
TerraFusion: Joint Generation of Terrain Geometry and Texture Using Latent Diffusion Models
- 用潜在扩散模型联合生成高度图与纹理，学习几何与颜色的关联。
- 无监督预训练后，通过手绘草图实现用户可控的地形生成。
- 适合游戏开发、影视制作等需要真实地形的场景设计。
3D地形模型在视频游戏开发和影视制作中至关重要。由于表面颜色常与地形几何结构相关，捕捉这种关联对实现真实感至关重要。然而，现有方法通常仅生成高度图或纹理，未能充分考虑其内在联系。本文提出一种基于潜在扩散模型的联合生成方法，首先在无监督条件下随机生成配对的高度图与纹理；随后通过外部适配器的有监督学习，实现用户通过手绘草图进行控制。实验表明，该方法可在保持高度图与纹理关联性的前提下，实现直观的地形生成。
原文摘要 · Abstract (English)
3D terrain models are essential in fields such as video game development and film production. Since surface color often correlates with terrain geometry, capturing this relationship is crucial to achieving realism. However, most existing methods generate either a heightmap or a texture, without sufficiently accounting for the inherent correlation. In this paper, we propose a method that jointly generates terrain heightmaps and textures using a latent diffusion model. First, we train the model in an unsupervised manner to randomly generate paired heightmaps and textures. Then, we perform supervised learning of an external adapter to enable user control via hand-drawn sketches. Experiments show that our approach allows intuitive terrain generation while preserving the correlation between heightmaps and textures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。