让程序化3D模型家族实现一致且实时的文本生成贴图。
ProcTex: Consistent and Interactive Text-to-texture Synthesis for Part-based Procedural Models
- 先生成模板形状贴图,再通过密集对应关系迁移到其他形状。
- 支持交互式设计,生成速度满足实时操作需求。
- 适合需要快速迭代外观的3D建模与游戏开发人员。
生成建模的进展推动了文本引导贴图合成的发展。然而,现有方法主要针对单个静态3D物体,难以处理由程序化代码生成的形状族。直接对每个程序化形状应用现有方法效率过低,无法实现实时交互,且导致不同形状间贴图不一致。为此,我们提出ProcTex,首个专为基于部件的程序化模型设计的文本到贴图系统。ProcTex实现了形状族的一致性、实时文本引导贴图生成,可无缝融入程序化建模的交互流程。核心方法是:从程序化模型中提取模板形状生成贴图,再通过求解密集对应关系将贴图迁移至其他形状。为保证交互性,我们提出一种新型对应网络,证明神经网络能有效学习程序化模型的密集对应关系。此外,还开发了重贴图管道以支持程序参数引起的结构变化,以及部件级UV贴图生成以实现局部外观编辑。在多样化的程序化模型上进行的大量实验验证了ProcTex在保持高质量与视觉一致性的同时,支持交互式应用的能力。
原文摘要 · Abstract (English)
Recent advances in generative modeling have driven significant progress in text-guided texture synthesis. However, current methods focus on synthesizing texture for single static 3D object, and struggle to handle entire families of shapes, such as those produced by procedural programs. Applying existing methods naively to each procedural shape is too slow to support exploring different parameter configurations at interactive rates, and also results in inconsistent textures across the procedural shapes. To this end, we introduce ProcTex, the first text-to-texture system designed for part-based procedural models. ProcTex enables consistent and real-time text-guided texture synthesis for families of shapes, which integrates seamlessly with the interactive design flow of procedural modeling. To ensure consistency, our core approach is to synthesize texture for a template shape from the procedural model, followed by a texture transfer stage to apply the texture to other procedural shapes via solving dense correspondence. To ensure interactiveness, we propose a novel correspondence network and show that dense correspondence can be effectively learned by a neural network for procedural models. We also develop several techniques, including a retexturing pipeline to support structural variation from procedural parameters, and part-level UV texture map generation for local appearance editing. Extensive experiments on a diverse set of procedural models validate ProcTex's ability to produce high-quality, visually consistent textures while supporting interactive applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。