用自然语言生成乐高组装结构并由机器人实现实体搭建
Prompt-to-Product: Generative Assembly via Bimanual Manipulation
- 输入文字指令，自动生成可物理搭建的乐高结构设计
- 通过双臂机器人完成实体搭建，用户研究显示效率提升显著
- 适合想快速实现创意构想的设计师和教育用户
制作装配类产品需要大量人工投入和专业知识，包括设计与构建两方面。本文提出 Prompt-to-Product，一个从自然语言指令自动生成真实装配产品的自动化流程。以乐高积木为装配平台，该系统根据用户需求生成可物理搭建的积木结构设计，并利用双臂机器人系统实际搭建出实体产品，将用户想象力变为现实。我们开展了全面的用户研究，结果表明该方法显著降低了创作门槛，大幅减少了手动操作量，使基于想象构思的产品实现更加便捷。
原文摘要 · Abstract (English)
Creating assembly products demands significant manual effort and expert knowledge in 1) designing the assembly and 2) constructing the product. This paper introduces Prompt-to-Product, an automated pipeline that generates real-world assembly products from natural language prompts. Specifically, we leverage LEGO bricks as the assembly platform and automate the process of creating brick assembly structures. Given the user design requirements, Prompt-to-Product generates physically buildable brick designs, and then leverages a bimanual robotic system to construct the real assembly products, bringing user imaginations into the real world. We conduct a comprehensive user study, and the results demonstrate that Prompt-to-Product significantly lowers the barrier and reduces manual effort in creating assembly products from imaginative ideas.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。