用自监督方法学习CAD模型表示,小样本下也能高效完成分类与识别任务。
Masked BRep Autoencoder via Hierarchical Graph Transformer
- 通过掩码图自编码器重建几何与属性,提升模型泛化能力。
- 层级图Transformer融合全局与局部信息,建模长距离几何依赖。
- 仅需少量标注数据即可在多种下游任务中取得优异表现。
我们提出一种新型自监督学习框架,从输入的计算机辅助设计(CAD)模型中自动学习表征,用于零件分类、建模分割和加工特征识别等下游任务。为训练网络,我们构建了一个大规模无标签的边界表示(BRep)模型数据集。算法成功依赖于两个关键组件:一是掩码图自编码器,通过重建随机掩码的BRep几何与属性进行表征学习,增强泛化能力;二是分层图Transformer架构,通过跨尺度互注意力模块建模长程几何依赖,同时利用图神经网络块聚合局部拓扑信息。训练完成后,将自编码器的解码器替换为特定任务网络,并在少量标注数据上微调。实验表明,该模型在各类任务中均表现优异,尤其在训练数据极少时优势显著,验证了其实际应用价值与通用性。
原文摘要 · Abstract (English)
We introduce a novel self-supervised learning framework that automatically learns representations from input computer-aided design (CAD) models for downstream tasks, including part classification, modeling segmentation, and machining feature recognition. To train our network, we construct a large-scale, unlabeled dataset of boundary representation (BRep) models. The success of our algorithm relies on two keycomponents. The first is a masked graph autoencoder that reconstructs randomly masked geometries and attributes of BReps for representation learning to enhance the generalization. The second is a hierarchical graph Transformer architecture that elegantly fuses global and local learning by a cross-scale mutual attention block to model long-range geometric dependencies and a graph neural network block to aggregate local topological information. After training the autoencoder, we replace its decoder with a task-specific network trained on a small amount of labeled data for downstream tasks. We conduct experiments on various tasks and achieve high performance, even with a small amount of labeled data, demonstrating the practicality and generalizability of our model. Compared to other methods, our model performs significantly better on downstream tasks with the same amount of training data, particularly when the training data is very limited.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。