用稀疏体素引导表面编织,实现高效高保真网格自回归生成。
MeshWeaver: Sparse-Voxel-Guided Surface Weaving for Autoregressive Mesh Generation

- 直接预测顶点而非坐标,结合多级稀疏体素编码器注入几何上下文。
- 压缩率高达18%,支持生成最多16000个面的高精度网格。
- 适合需要高质量3D网格生成的研究者与工业应用开发者。
自回归网格生成通过将网格分词为序列并采用语言建模方式训练,但现有方法存在两大缺陷:(i) 分词效率低,导致序列过长,难以扩展至高面数网格;(ii) 缺乏几何感知引导,生成仅依赖全局形状嵌入,忽略局部表面特征。本文提出MeshWeaver,将网格生成视为表面编织过程,直接预测下一个顶点。其核心是一个多层级稀疏体素编码器,以三种互补方式注入几何信息:将体素特征作为顶点表示、通过交叉注意力引导分词预测、作为结构支架约束生成在输入表面附近进行。层级设计支持单次解码完成粗到细的顶点预测,并紧密耦合生成模型与三维几何。大量实验表明,MeshWeaver达到18%的先进压缩率,可生成最多16000面的网格,显著提升几何保真度。
原文摘要 · Abstract (English)
Autoregressive mesh generation has gained attention by tokenizing meshes into sequences and training models in a language-modeling fashion. However, existing approaches suffer from two fundamental limitations: (i) low tokenization efficiency, which yields long token sequences and prevents scaling to high-poly meshes, and (ii) absence of geometry-aware guidance, as generation is conditioned only on global shape embeddings rather than local surface cues. We introduce MeshWeaver, an autoregressive framework that treats mesh generation as a surface weaving process by directly predicting the next vertex instead of independent coordinates. At its core is a multi-level sparse-voxel encoder that injects geometric context into the generative process in three complementary ways: providing voxel features as vertex representations, guiding token prediction via cross-attention to voxel features, and serving as a structural scaffold that constrains generation around the input surface. Our hierarchical design enables coarse-to-fine vertex prediction in a single decoding step, while tightly coupling the generative model with 3D geometry. Extensive experiments demonstrate that MeshWeaver achieves a state-of-the-art compression ratio of 18%, can generate meshes with up to 16K faces, and significantly improves geometric fidelity over prior approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。