自监督学习3D CAD几何模型,实现高精度重建与可解释分析
Shape: A Self-Supervised 3D Geometry Foundation Model for Industrial CAD Analysis

- 用多尺度几何令牌化+变压器处理3D网格,生成密集嵌入
- 重建R2达0.729,检索准确率98.1%,训练验证差距极小
- 适合工业设计、逆向工程等需可解释3D分析的场景
工业CAD工作流需要鲁棒且通用的3D几何表征以支持精度与可解释性。我们提出Shape,一种自监督基础模型,将表面网格转换为密集的每标记嵌入。Shape结合结构化3D潜在网格、多尺度几何感知分词器(MAGNO)与交叉注意力,以及使用分组查询注意力和RMSNorm的变压器处理器。通过学习的重建先验,实现区域级归因以支持可解释预测。预训练采用归一化几何统计量的掩码标记重建和多分辨率对比一致性。1090万参数主干网络在Thingi10K、MFCAD和Fusion360的61,052个CAD网格上进行预训练。在2,983个预留网格上,Shape达到重建R2 = 0.729,Wang-Isola协议下98.1%的top-1检索准确率,训练/验证重建差距接近零(对比分数使用更大评估池)。2×2消融实验显示,维度归一化至关重要:无此操作时性能崩溃(R2 < 0.14,top-1 < 88%);有则双损失均有效(R2 > 0.70,top-1 > 96%)。Smooth-L1提供次优稳定性。代码、嵌入及交互式演示已发布于https://github.com/simd-ai/shape。
原文摘要 · Abstract (English)
Industrial CAD workflows require robust, generalizable 3D geometric representations supporting accuracy and explainability. We introduce Shape, a self-supervised foundation model converting surface meshes into dense per-token embeddings. Shape combines a structured 3D latent grid, a multi-scale geometry-aware tokenizer (MAGNO) with cross-attention, and a transformer processor using grouped-query attention and RMSNorm. A learned reconstruction prior enables per-region attribution for explainable predictions. Pretraining uses masked-token reconstruction of normalized geometry statistics and multi-resolution contrastive consistency. The 10.9M-parameter backbone is pretrained on 61,052 CAD meshes from Thingi10K, MFCAD, and Fusion360. On a held-out split of 2,983 meshes, Shape achieves reconstruction R2 = 0.729 and 98.1% top-1 retrieval under the Wang-Isola protocol, with near-zero reconstruction train/val gap (contrastive scores use a larger evaluation pool). A 2x2 ablation on loss type and target-space normalization shows per-dimension normalization is critical: without it, performance collapses (R2 < 0.14, top-1 < 88%); with it, both losses succeed (R2 > 0.70, top-1 > 96%). Smooth-L1 offers secondary stability. Code, embeddings, and an interactive demo are released at https://github.com/simd-ai/shape.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。