用分层调优提升2D工程图的精准分析能力
PHT-CAD: Efficient CAD Parametric Primitive Analysis with Progressive Hierarchical Tuning
- 提出EHP混合参数化表示,用点线圆弧四类原子组件建模
- 在1000万张标注图上训练,测试3000张真实工业图表现优异
- 适合需要高精度图纸理解的工业设计与自动化场景
计算机辅助设计(CAD)在工业制造中至关重要,但二维参数化图元分析(PPA)因结构约束推理和语义理解不足而研究较少。为此,本文提出高效混合参数化(EHP),以点、线、圆、弧四类原子组件更准确地表示二维工程图。进一步提出PHT-CAD框架,利用视觉-语言模型的对齐与推理能力实现精确分析,并设计四个回归头预测对应图元。为训练该模型,提出三阶段分层渐进调优(PHT)策略,逐步增强对单个图元感知、结构约束推断及标注层与几何表示对齐的能力。针对现有数据集缺乏完整标注层和真实工程图的问题,构建了首个大规模基准ParaCAD,包含超1000万张标注训练图和3000张具复杂拓扑与物理约束的真实工业测试图。大量实验验证了PHT-CAD的有效性,凸显ParaCAD在推动2D PPA研究中的实践价值。
原文摘要 · Abstract (English)
Computer-Aided Design (CAD) plays a pivotal role in industrial manufacturing, yet 2D Parametric Primitive Analysis (PPA) remains underexplored due to two key challenges: structural constraint reasoning and advanced semantic understanding. To tackle these challenges, we first propose an Efficient Hybrid Parametrization (EHP) for better representing 2D engineering drawings. EHP contains four types of atomic component i.e., point, line, circle, and arc). Additionally, we propose PHT-CAD, a novel 2D PPA framework that harnesses the modality alignment and reasoning capabilities of Vision-Language Models (VLMs) for precise engineering drawing analysis. In PHT-CAD, we introduce four dedicated regression heads to predict corresponding atomic components. To train PHT-CAD, a three-stage training paradigm Progressive Hierarchical Tuning (PHT) is proposed to progressively enhance PHT-CAD's capability to perceive individual primitives, infer structural constraints, and align annotation layers with their corresponding geometric representations. Considering that existing datasets lack complete annotation layers and real-world engineering drawings, we introduce ParaCAD, the first large-scale benchmark that explicitly integrates both the geometric and annotation layers. ParaCAD comprises over 10 million annotated drawings for training and 3,000 real-world industrial drawings with complex topological structures and physical constraints for test. Extensive experiments demonstrate the effectiveness of PHT-CAD and highlight the practical significance of ParaCAD in advancing 2D PPA research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。