用文字描述生成逼真编织布料,兼顾宏观纹理与微观编织结构。
FabricGen: Microstructure-Aware Woven Fabric Generation
- 分离宏观纹理与微观编织结构,分别建模生成
- 通过微调大模型实现文本到编织图稿的自动设计
- 生成的布料细节更丰富,符合真实编织规律
编织布料广泛应用于渲染场景,但设计逼真样本通常需多阶段操作,依赖织造原理与贴图创作知识。近期研究尝试用扩散模型简化流程,但预训练模型常难以生成符合织造规则的精细纱线级细节。为此,我们提出FabricGen,一个从文本描述端到端生成高质量编织布料材料的框架。核心思路是将宏观纹理与微观编织图案分离开来:为生成无微结构的宏观纹理,我们在收集的无微结构布料数据集上微调预训练扩散模型;针对微观编织图案,我们开发了一种增强型过程化几何模型,可合成自然的纱线级几何形态,包含纱线滑移和飞丝现象。该模型由专用大语言模型WeavingLLM驱动,该模型在标注的织造图稿数据集上进行微调,并结合领域专业知识进行提示微调。通过微调与提示微调,WeavingLLM能从文本提示中学习设计织造图稿与布料参数,使过程化模型生成多样化且遵循织造原则的编织图案。最终生成的宏观纹理与微观几何可用于布料渲染,相比以往生成模型,本框架产生的材料具有显著更丰富的细节与真实感。
原文摘要 · Abstract (English)
Woven fabric materials are widely used in rendering applications, yet designing realistic examples typically involves multiple stages, requiring expertise in weaving principles and texture authoring. Recent advances have explored diffusion models to streamline this process; however, pre-trained diffusion models often struggle to generate intricate yarn-level details that conform to weaving rules. To address this, we present FabricGen, an end-to-end framework for generating high-quality woven fabric materials from textual descriptions. A key insight of our method is the decomposition of macro-scale textures and micro-scale weaving patterns. To generate macro-scale textures free from microstructures, we fine-tune pre-trained diffusion models on a collected dataset of microstructure-free fabrics. As for micro-scale weaving patterns, we develop an enhanced procedural geometric model capable of synthesizing natural yarn-level geometry with yarn sliding and flyaway fibers. The procedural model is driven by a specialized large language model, WeavingLLM, which is fine-tuned on an annotated dataset of formatted weaving drafts, and prompt-tuned with domain-specific fabric expertise. Through fine-tuning and prompt tuning, WeavingLLM learns to design weaving drafts and fabric parameters from textual prompts, enabling the procedural model to produce diverse weaving patterns that stick to weaving principles. The generated macro-scale texture, along with the micro-scale geometry, can be used for fabric rendering. Consequently, our framework produces materials with significantly richer detail and realism compared to prior generative models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。