用仿真反馈优化生成模型,高效找到工程设计的最优权衡解集。
e-SimFT: Alignment of Generative Models with Simulation Feedback for Pareto-Front Design Exploration
- 用仿真器替代人工反馈,对生成模型进行偏好对齐微调。
- 提出epsilon采样法,生成高质量帕累托前沿解集。
- 首次将大模型对齐思想用于工程设计,适合工业研发人员参考。
深度生成模型在解决复杂工程设计问题中表现优异,能根据输入的设计要求预测可行解。然而,在多目标设计中,满足所有要求的解往往不可行,工程师更关注一组帕累托最优解。现有生成模型均匀采样难以获得有效帕累托前沿。为此,本文提出e-SimFT框架,首次将大语言模型的偏好对齐方法应用于生成模型的工程设计微调,使用仿真器提供准确且可扩展的反馈。同时,受经典优化算法中epsilon约束法启发,提出epsilon采样策略,构建高质量帕累托前沿。实验表明,e-SimFT生成的帕累托前沿优于现有多目标对齐方法。
原文摘要 · Abstract (English)
Deep generative models have recently shown success in solving complex engineering design problems where models predict solutions that address the design requirements specified as input. However, there remains a challenge in aligning such models for effective design exploration. For many design problems, finding a solution that meets all the requirements is infeasible. In such a case, engineers prefer to obtain a set of Pareto optimal solutions with respect to those requirements, but uniform sampling of generative models may not yield a useful Pareto front. To address this gap, we introduce a new framework for Pareto-front design exploration with simulation fine-tuned generative models. First, the framework adopts preference alignment methods developed for Large Language Models (LLMs) and showcases the first application in fine-tuning a generative model for engineering design. The important distinction here is that we use a simulator instead of humans to provide accurate and scalable feedback. Next, we propose epsilon-sampling, inspired by the epsilon-constraint method used for Pareto-front generation with classical optimization algorithms, to construct a high-quality Pareto front with the fine-tuned models. Our framework, named e-SimFT, is shown to produce better-quality Pareto fronts than existing multi-objective alignment methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。