arXiv:2602.03045cs.LG2026-02被引 7

让AI先问清楚再画图,解决文本生成3D建模时的模糊和矛盾问题

Clarify Before You Draw: Proactive Agents for Robust Text-to-CAD Generation

  • AI先主动提问澄清模糊需求,确保设计一致后再生成代码
  • 相比现有模型,错误率从4.8%降至0.9%,几何误差降低79.9%
  • 适合需要高精度工业设计的工程师与自动化建模开发者

大语言模型已实现从自然语言生成参数化CAD程序(如CadQuery)的能力。然而实际中,几何描述常存在信息缺失或内部矛盾:关键尺寸缺失、约束冲突等。现有微调模型多被动执行指令,遇模糊文本会幻觉生成尺寸。为此,我们提出名为ProCAD的主动代理框架,通过一个主动澄清代理在代码生成前审计提示,仅在必要时提出精准问题以获得自洽的设计规范;另一编码代理则将规范转化为可执行的CadQuery程序。基于高质量文本到CadQuery数据集微调编码代理,并通过代理式监督微调训练澄清代理。实验表明,主动澄清显著提升对模糊提示的鲁棒性,同时保持低交互开销。ProCAD优于前沿闭源模型(如Claude Sonnet 4.5),平均切比雪夫距离降低79.9%,无效率由4.8%降至0.9%。代码与数据集已在https://github.com/BoYuanVisionary/Pro-CAD公开。

原文摘要 · Abstract (English)

Large language models have recently enabled text-to-CAD systems that synthesize parametric CAD programs (e.g., CadQuery) from natural-language prompts. In practice, however, geometric descriptions can be under-specified or internally inconsistent: critical dimensions may be missing and constraints may conflict. However, existing fine-tuned models tend to reactively follow the user instructions and hallucinate dimensions when the text is ambiguous. To address this, we propose a proactive agentic framework for text-to-CadQuery generation, named as ProCAD, that resolves specification issues before code synthesis. Our framework pairs a proactive clarifying agent, which audits the prompt and asks targeted clarification questions only when necessary to produce a self-consistent specification, with a CAD coding agent that translates the specification into an executable CadQuery program. We fine-tune the coding agent based on a curated high-quality text-to-CadQuery dataset and train the clarifying agent via agentic SFT on clarification trajectories. Experiments show that proactive clarification significantly improves robustness to ambiguous prompts while keeping interaction overhead low. ProCAD outperforms frontier closed-source models, including Claude Sonnet 4.5, reducing the mean Chamfer distance by 79.9% and lowering the invalidity ratio from 4.8% to 0.9%. Our code and datasets are made publicly available on https://github.com/BoYuanVisionary/Pro-CAD.

文本生成CAD建模主动代理工业设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。