arXiv:2605.05572cs.CV2026-05

用自然语言搜索工业设计模型,提升旧设计复用效率。

Text-to-CAD Retrieval: a Strong Baseline

论文配图:Text-to-CAD Retrieval: a Strong Baseline
图 1 · 摘自论文原文
  • 融合构造逻辑与几何特征,统一建模文本与CAD
  • 在Text2CAD数据集上达到领先检索性能
  • 适合工业设计复用与生成任务研究者

基于文本的计算机辅助设计(CAD)模型检索是重用遗留工业设计的关键但研究不足的任务。现有CAD库多依赖文件名或目录搜索,限制了检索效率、可扩展性和准确性。本文首次正式提出文本到CAD检索这一跨模态任务,旨在根据自然语言查询从大规模数据库中检索语义相关的CAD模型。利用Text2CAD数据集中配对的文本-CAD标注,我们建立了该任务的实用基准。为实现文本检索,提出统一框架,从过程序列和几何点云中学习多模态CAD嵌入。序列编码器捕捉CAD模型的构建逻辑,点编码器提取显式几何特征,文本编码器学习查询语义表示。训练时引入新颖的特征解码器,通过文本与点特征的交叉注意力重建被掩码的序列特征,促进隐式多模态对齐。推理时移除该辅助解码器,使用拼接的序列-点特征实现高效检索。该框架作为文本到CAD检索的强基线,为下游CAD生成范式(如检索增强生成)奠定基础。源代码将公开。

原文摘要 · Abstract (English)

Text-based retrieval of Computer-Aided Design (CAD) models is a critical yet underexplored task for the reuse of legacy industrial designs. Existing CAD repositories are typically searched using filenames or directories, which limits the efficiency, scalability, and accuracy of design retrieval. In this paper, we formally introduce text-to-CAD retrieval as a new cross-modal retrieval task, aiming to retrieve semantically relevant CAD models from large-scale databases given natural language queries. Leveraging paired text-CAD annotations from the Text2CAD dataset, we establish a practical benchmark for this task. To achieve text-based retrieval, we propose a unified framework that learns multi-modal CAD embeddings from both procedural sequences and geometric point clouds. Specifically, a sequence encoder captures the construction logic of CAD models, while a point encoder extracts explicit geometric features. A text encoder is used to learn semantic representations of textual queries. During training, we introduce a novel feature decoder that reconstructs masked sequence features via cross-attention with text and point features, encouraging implicit multi-modal alignment. At inference time, we remove this auxiliary decoder to enable efficient retrieval using concatenated sequence-point features. Our framework serves as a strong baseline for text-to-CAD retrieval and lays the foundation for downstream CAD generation paradigms, such as retrieval-augmented generation. The source code will be released.

CAD检索跨模态工业设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。