arXiv:2502.11390cs.CV2025-02被引 7

MARS通过自回归生成实现3D网格细节化,保持形状一致性。

MARS: Mesh AutoRegressive Model for 3D Shape Detailization

  • 用多层级、多类别网格表示学习跨层级一致的隐空间特征
  • 自回归模型通过预测下一层级令牌生成细节,提升真实感
  • 适合需要高保真细节生成的3D建模与工业设计场景

当前主流的网格细节化方法多采用生成对抗网络(GAN)从粗网格生成细节网格,但通常为每类或相似类别学习特定风格码,且缺乏跨不同细节层级(LOD)的几何监督,导致泛化能力差,难以保证生成过程中的形状一致性。本文提出MARS,一种新型3D形状细节化方法。该方法利用新颖的多层级、多类别网格表示,在不同细节层级间学习形状一致的隐空间表征,并设计了一种网格自回归模型,通过下一层级令牌预测生成此类隐表示。该方法显著提升了生成形状的真实感。在具有挑战性的3D形状细节化基准上的大量实验表明,MARS在定性和定量评估中均达到当前最优性能,尤其在生成精细细节并保持整体形状完整性方面表现突出。

原文摘要 · Abstract (English)

State-of-the-art methods for mesh detailization predominantly utilize Generative Adversarial Networks (GANs) to generate detailed meshes from coarse ones. These methods typically learn a specific style code for each category or similar categories without enforcing geometry supervision across different Levels of Detail (LODs). Consequently, such methods often fail to generalize across a broader range of categories and cannot ensure shape consistency throughout the detailization process. In this paper, we introduce MARS, a novel approach for 3D shape detailization. Our method capitalizes on a novel multi-LOD, multi-category mesh representation to learn shape-consistent mesh representations in latent space across different LODs. We further propose a mesh autoregressive model capable of generating such latent representations through next-LOD token prediction. This approach significantly enhances the realism of the generated shapes. Extensive experiments conducted on the challenging 3D Shape Detailization benchmark demonstrate that our proposed MARS model achieves state-of-the-art performance, surpassing existing methods in both qualitative and quantitative assessments. Notably, the model's capability to generate fine-grained details while preserving the overall shape integrity is particularly commendable.

3D生成网格生成自回归模型形状一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。