自动检测并修复CAD程序错误，让3D设计更精准。
CADReview: Automatically Reviewing CAD Programs with Error Detection and Correction
- 构建ReCAD框架，结合程序分析与视觉对比识别错误
- 在2万+程序-图像对上实现显著优于现有模型的纠错能力
- 适合需要高效验证3D设计一致性的工业设计师
计算机辅助设计（CAD）通过几何指令生成3D物体，在实际设计流程中，设计师常需耗时比对参考图像以审查和修改原型。为弥合这一差距，本文提出CAD审查任务，旨在自动检测并修正潜在错误，确保生成3D物体与参考图像的一致性。然而，现有先进的多模态大语言模型（MLLMs）难以识别多个几何组件或执行空间几何操作，导致审查不准确。为此，本文提出ReCAD框架，有效检测程序错误并提供可操作的修正反馈。同时，构建了包含超过2万组程序-图像对的CADReview数据集，涵盖多样化错误类型。大量实验表明，ReCAD显著优于现有MLLMs，展现出在设计应用中的巨大潜力。
原文摘要 · Abstract (English)
Computer-aided design (CAD) is crucial in prototyping 3D objects through geometric instructions (i.e., CAD programs). In practical design workflows, designers often engage in time-consuming reviews and refinements of these prototypes by comparing them with reference images. To bridge this gap, we introduce the CAD review task to automatically detect and correct potential errors, ensuring consistency between the constructed 3D objects and reference images. However, recent advanced multimodal large language models (MLLMs) struggle to recognize multiple geometric components and perform spatial geometric operations within the CAD program, leading to inaccurate reviews. In this paper, we propose the CAD program repairer (ReCAD) framework to effectively detect program errors and provide helpful feedback on error correction. Additionally, we create a dataset, CADReview, consisting of over 20K program-image pairs, with diverse errors for the CAD review task. Extensive experiments demonstrate that our ReCAD significantly outperforms existing MLLMs, which shows great potential in design applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。