让AI学习专家造材质的全过程,生成更专业的3D材料。
Reflecting Process Expertise in Procedural Material Generation

- 用文本记录专家制作流程,作为可检索的知识
- 用户意图+视频分析生成可执行的Blender材质图
- 实测减少编辑次数,适合想快速出专业材质的设计师
程序化材质生成支撑数字内容创作、视觉特效和3D资产设计。高质量结果不仅依赖节点图复现,更需理解专家构建过程。本文将程序化材质生成建模为检索时的过程推理,将过程作为首要表征,超越仅基于图的合成。具体地,将专家工作流表示为过程轨迹:包含构建步骤、参数和设计意图的文本记录。通过预训练的LLM-based ProcessSynthesizer生成与用户意图一致的过程轨迹,并用预训练的LLM-based Compiler将其转化为可执行的Blender材质图。因过程知识最自然地通过演示传递,本文利用教程视频作为过程知识源,使用自动化视频分析工具提取可被LLM使用的文本轨迹。五位平均7.5年经验的Blender艺术家参与专家研究,结果显示,反映专家示范生成的材质所需修改更少,更贴近专业设计策略;150名用户的用户体验研究进一步表明,该方法在生成与编辑性能上优于以往程序系统。所有代码、模型与数据将公开于https://materialapprentice.github.io
原文摘要 · Abstract (English)
Procedural material creation underpins applications in digital content creation, visual effects, and 3D asset design. Achieving high-quality results requires more than reproducing node graphs -- it demands understanding the process by which experts construct materials. We formulate procedural material generation as retrieval-time process reasoning over expert demonstrations, elevating process to a first-class representation beyond graph-only synthesis. Concretely, we represent expert workflows as process traces: textual records of construction steps, parameters, and design intent. To instantiate this idea, we use a pretrained LLM-based ProcessSynthesizer to synthesize a process trace aligned with a user's intent and a pretrained LLM-based Compiler to ground the process trace into an executable Blender material graph. Because procedural expertise is most naturally conveyed through demonstrations, we leverage tutorial videos as a source of process knowledge and extract textual, LLM-compatible traces using automated video analysis tools. In an expert study with five Blender artists (avg. 7.5 years of experience), materials generated by reflecting expert demonstrations were found to produce workflows requiring fewer edits, and more closely match professional design strategies than methods operating solely on static artifacts. A user study with 150 participants further shows that our approach achieves superior generation and editing performance compared to prior procedural systems. All code, models, and data will be available at https://materialapprentice.github.io
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。