用大模型预测原型成本性能,比人类更准。
Predictive Prototyping: Evaluating Design Concepts with ChatGPT
- 用GPT-4o结合网页数据生成设计反馈,模拟原型评估
- 预测成本和性能优于单人或多人估算,可用性相当
- 适合想快速验证设计的工程师和创业者
设计-建造-测试循环是创新的核心,但物理原型制作常耗时且昂贵。尽管基于物理的仿真和策略性原型能降低成本,有意义的评估通常要等到集成原型完成后才能进行。本文研究生成式预训练变压器(GPT)是否可预测传统上通过原型获得的信息,包括成本、性能和感知可用性。我们提出一种检索增强生成(RAG)方法,利用OpenAI GPT-4o,并基于从Instructables.com抓取的原型数据来增强相关先例获取。报告了两项研究:第一项为受控实验,对比GPT-RAG与人类设计师在仅获设计草图的情况下对成本、性能和可用性的预测,结果与真实物理原型对比;第二项为实际演示,根据GPT-RAG建议制作物理原型,并与商用基准和拓扑优化设计对比。结果显示,GPT-RAG在成本和性能预测上优于个体或群体人类估计,可用性预测相当;基于GPT-RAG建议的原型表现优于两个对照原型。重复查询并平均输出显著提升准确性,表明大模型可模拟符合大数定律的群体聚合效应。
原文摘要 · Abstract (English)
The design-build-test cycle is essential for innovation, but physical prototyping is often slow and expensive. Although physics-based simulation and strategic prototyping can reduce cost, meaningful evaluation is frequently constrained until an integrated prototype is built. This paper investigates whether a generative pretrained transformer (GPT) can predict information typically obtained through prototyping, including cost, performance, and perceived usability. We introduce a retrieval-augmented generation (RAG) method to emulate design feedback using OpenAI GPT-4o, grounded in prototyping data scraped from Instructables.com to increase access to relevant precedent. Two studies are reported. First, a controlled experiment compares GPT-RAG and human designers, who receive design sketches and predict cost, performance, and usability; predictions are evaluated against ground-truth results from physical prototypes. Second, we report an applied demonstration in which a physical prototype is produced from GPT-RAG recommendations and compared with a commercial baseline and a topology-optimized design. Results show that GPT-RAG provides more accurate cost and performance estimates than individual or crowd human estimates, while yielding comparable usability insights; the GPT-RAG-informed prototype also outperforms both comparison prototypes. Repeated querying with response averaging significantly improves accuracy, suggesting that LLMs can emulate crowd aggregation effects consistent with the law of large numbers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。