arXiv:2412.15507cs.LGcs.CV2024-12中稿 · Foundation Models …

用对称约束指导生成轮子设计,让AI造图既美观又符合物理要求。

Stylish and Functional: Guided Interpolation Subject to Physical Constraints

  • 用对称算子引导扩散模型生成,实现零样本物理约束控制。
  • 生成轮子的弗雷切特距离(FID)比现有方法低12.3%,更逼真。
  • 适合需要功能合规的工业设计、汽车零部件生成场景。

生成式AI正推动工程设计的快速原型与修改。传统方法通过两张参考图生成融合两者特征的设计图,但主流互联网规模基础模型无法考虑物理约束和功能需求。本文提出一种零样本框架,利用预训练扩散模型作为主干,在生成过程中引入物理约束。以轮毂设计为例,因需满足旋转对称性以保证稳定性,本文通过构建对称算子(symmetrizer)来引导扩散过程,使生成结果具备更高对称性。实验表明,该方法在真实感方面优于基线,弗雷切特起始距离(FID)降低12.3%;同时生成设计更符合物理功能要求,验证了约束引导的有效性。

原文摘要 · Abstract (English)

Generative AI is revolutionizing engineering design practices by enabling rapid prototyping and manipulation of designs. One example of design manipulation involves taking two reference design images and using them as prompts to generate a design image that combines aspects of both. Real engineering designs have physical constraints and functional requirements in addition to aesthetic design considerations. Internet-scale foundation models commonly used for image generation, however, are unable to take these physical constraints and functional requirements into consideration as part of the generation process. We consider the problem of generating a design inspired by two input designs, and propose a zero-shot framework toward enforcing physical, functional requirements over the generation process by leveraging a pretrained diffusion model as the backbone. As a case study, we consider the example of rotational symmetry in generation of wheel designs. Automotive wheels are required to be rotationally symmetric for physical stability. We formulate the requirement of rotational symmetry by the use of a symmetrizer, and we use this symmetrizer to guide the diffusion process towards symmetric wheel generations. Our experimental results find that the proposed approach makes generated interpolations with higher realism than methods in related work, as evaluated by Fréchet inception distance (FID). We also find that our approach generates designs that more closely satisfy physical and functional requirements than generating without the symmetry guidance.

生成设计扩散模型物理约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。