arXiv:2607.28675cs.GRcs.CV2026-07

用流匹配加速3D网格生成,6秒内完成图像到网格的高质量转化

Meshy T2: Fast Native Mesh Generation with Flow Matching

论文配图:Meshy T2: Fast Native Mesh Generation with Flow Matching
图 1 · 摘自论文原文
  • 基于流匹配的单次并行生成,跳过传统逐词解码
  • 6秒内完成端到端生成,面数可控且保持精细拓扑结构
  • 支持多部件资产直接生成,适合游戏影视实时创作

多边形网格是现代3D流程的标准表面表示方式,生成具有艺术家风格拓扑的高质量网格对电影、游戏和交互式3D应用至关重要。主流方法将网格序列化为标记序列并自回归解码,推理速度慢且易累积误差,难以用于交互式资产创建。我们提出Meshy T2,一种基于流匹配的快速原生网格生成框架。核心是一个顶点集网格变分自编码器(VAE),每个顶点对应一个连续潜在标记,可一次性解码顶点、边连接关系和面朝向,无需顶点量化或焊接,保持高精度几何与人工拓扑。生成采用粗到细级联设计:先通过图像条件的体素流生成粗略占据结构,再由网格流在结构上填充顶点潜在标记,条件包括图像、骨架和请求的顶点预算。该设计实现三项实用能力:通过并行流合成实现交互式生成速度;通过顶点预算有效控制面数;天然支持多部件资产,其组件直接从生成的连接性中浮现。实验表明,Meshy T2在几何保真度上达到业界最优,端到端图像到网格生成中位时间仅为6秒,比自回归基线快一个数量级以上。代码与权重将发布于https://github.com/meshy-dev/meshy-t2。

原文摘要 · Abstract (English)

Polygonal meshes are the standard surface representation of modern 3D pipelines, and generating high-quality meshes with artist-style topology is essential for film, gaming, and interactive 3D applications. Mainstream approaches serialize a mesh into a token sequence and decode it autoregressively, which is slow at inference and sensitive to error accumulation, making them impractical for interactive asset creation. We present Meshy T2, a fast native mesh generation framework built on flow matching. At its core is a vertex-set mesh VAE that encodes a mesh into one continuous latent token per vertex and decodes vertices, edge connectivity, and face winding order in a single pass, preserving high-precision geometry and artist-authored topology without vertex quantization or welding. Generation proceeds as a coarse-to-fine cascade of two flow-matching models: an image-conditioned voxel flow first sketches the overall shape as a coarse occupancy scaffold, and a mesh flow then populates the scaffold with per-vertex latent tokens, conditioned on the image, the scaffold, and a requested vertex budget. This design delivers three practical capabilities: interactive generation speed through parallel flow-based synthesis; effective face-count control through the requested vertex budget; and native support for multi-part assets, whose components emerge directly from the generated connectivity. In our experiments, Meshy T2 achieves state-of-the-art geometric fidelity and completes end-to-end image-to-mesh generation within a median of 6 seconds, over an order of magnitude faster than autoregressive baselines. Code and weights will be available at https://github.com/meshy-dev/meshy-t2.

3D生成流匹配网格生成实时创作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。