arXiv:2507.04285cs.CVcs.AI2025-07SIGGRAPH被引 8

直接生成高质量3D纹理图,避免传统方法的误差累积问题。

SeqTex: Generate Mesh Textures in Video Sequence

  • 将3D纹理生成转为序列生成任务,联合建模多视角与UV纹理分布。
  • 在图像和文本条件任务上均达当前最佳,3D一致性与细节保真度高。
  • 适合需要真实感3D内容生成的研究者与工业应用开发者。

训练原生3D纹理生成模型仍是一个基础但极具挑战性的问题,主要受限于大规模高质量3D纹理数据集的稀缺性,这阻碍了其在真实场景中的泛化能力。现有方法通常微调预训练图像生成模型以利用其学习到的视觉先验,但这些方法仅能生成多视角图像,并依赖后处理生成UV纹理图——现代图形管线中的关键表示形式。此类两阶段流程常导致误差累积和3D表面空间不一致。本文提出SeqTex,一种新型端到端框架,利用预训练视频基础模型中的视觉知识,直接生成完整的UV纹理图。不同于以往孤立建模UV纹理分布的方法,SeqTex将任务重新表述为序列生成问题,使模型能够学习多视角渲染与UV纹理的联合分布。该设计有效将视频基础模型中的一致性图像先验迁移到UV域。为提升性能,我们提出多项架构创新:解耦的多视角与UV分支设计、几何感知注意力以引导跨域特征对齐、自适应令牌分辨率以在保持计算效率的同时保留精细纹理细节。这些组件共同使SeqTex充分利用预训练视频先验,无需后处理即可合成高保真度的UV纹理图。大量实验表明,SeqTex在图像条件与文本条件的3D纹理生成任务上均达到领先水平,具备更优的3D一致性、纹理-几何对齐性以及真实世界泛化能力。

原文摘要 · Abstract (English)

Training native 3D texture generative models remains a fundamental yet challenging problem, largely due to the limited availability of large-scale, high-quality 3D texture datasets. This scarcity hinders generalization to real-world scenarios. To address this, most existing methods finetune foundation image generative models to exploit their learned visual priors. However, these approaches typically generate only multi-view images and rely on post-processing to produce UV texture maps -- an essential representation in modern graphics pipelines. Such two-stage pipelines often suffer from error accumulation and spatial inconsistencies across the 3D surface. In this paper, we introduce SeqTex, a novel end-to-end framework that leverages the visual knowledge encoded in pretrained video foundation models to directly generate complete UV texture maps. Unlike previous methods that model the distribution of UV textures in isolation, SeqTex reformulates the task as a sequence generation problem, enabling the model to learn the joint distribution of multi-view renderings and UV textures. This design effectively transfers the consistent image-space priors from video foundation models into the UV domain. To further enhance performance, we propose several architectural innovations: a decoupled multi-view and UV branch design, geometry-informed attention to guide cross-domain feature alignment, and adaptive token resolution to preserve fine texture details while maintaining computational efficiency. Together, these components allow SeqTex to fully utilize pretrained video priors and synthesize high-fidelity UV texture maps without the need for post-processing. Extensive experiments show that SeqTex achieves state-of-the-art performance on both image-conditioned and text-conditioned 3D texture generation tasks, with superior 3D consistency, texture-geometry alignment, and real-world generalization.

3D生成纹理生成视频模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。