局部修复低多边形网格,只重生成有问题区域,不破坏其他部分。
MeshFIM: Local Low-Poly Mesh Editing via Fill-in-the-Middle Autoregressive Generation

- 基于上下文条件的自回归生成,仅重做目标区域。
- 在真实数据集上修复成功率超90%,比基线提升15%以上。
- 适合需要精细编辑或自动修复的3D建模用户。
自回归模型能从点云生成高质量低多边形网格,但存在局部不理想时需重生成整张网格的问题,浪费计算且破坏已有结构。本文提出MeshFIM,一种填中间(Fill-in-the-Middle)框架,可基于周围上下文条件重生成低多边形网格的目标区域。针对网格特有挑战——边界精确贴合、上下文拓扑保持、生成范围抑制——提出五项设计:边界顶点标记、上下文位置编码、扩大上下文宽度、上下文增强以及低多边形几何编码器,其门控减法机制通过参考面与现有网格的差异聚焦生成区域。详尽消融实验验证各组件有效性。基于MeshFIM,实现交互式画笔编辑与低多边形网格缺陷自动修复(见图1)。实验表明,该方法在网格细化、修复及整体生成+缝合方案中均优于多个基线。
原文摘要 · Abstract (English)
Autoregressive (AR) models can generate high-quality low-poly meshes from point clouds, but they still operate in an all-or-nothing manner: when a local region is unsatisfactory, the entire mesh must be regenerated, wasting computation and destroying satisfactory mesh structure elsewhere. We introduce MeshFIM, a Fill-in-the-Middle (FIM) framework that regenerates a target region of a low-poly mesh conditioned on the surrounding context. MeshFIM addresses three mesh-specific challenges: enforcing exact attachment along the exposed boundary, preserving topological order in the context, and suppressing overflow beyond the intended region. It does so with five complementary design choices: boundary vertex markers, context positional embeddings, expanded context width, context augmentation, and a low-poly geometry encoder whose gated subtraction mechanism focuses generation on the missing region by leveraging the difference between the reference surface and the existing mesh. Detailed ablation studies are presented to show the effectiveness of every introduced component. Based on MeshFIM, we demonstrate two applications: interactive brush-based editing and automatic defect repair on low-poly mesh (see Figure 1). Last but not least, experiments show that MeshFIM outperforms a range of baselines in mesh refinement, mesh repair and whole mesh generation plus stitch-back scheme.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。