arXiv:2511.03137cs.AI2025-11

用多模态大模型增强烟花算法,解决复杂高维优化难题

Using Multi-modal Large Language Model to Boost Fireworks Algorithm's Ability in Settling Challenging Optimization Tasks

  • 引入关键部分概念,结合多模态大模型提升烟花算法性能
  • 在旅行商和电子设计任务中达到或超越当前最优结果
  • 适合对智能优化算法感兴趣的科研与工程人员

随着优化问题日益复杂多样,优化技术与范式创新具有重要意义。此类问题常具非凸性、高维度、黑箱等不利特性,传统零阶或一阶方法因效率低、梯度信息不准、优化信息利用不足而难以应对。近年来,大语言模型(LLM)在语言理解与代码生成方面取得显著进展,促使研究者关注基于大模型的优化算法设计。本文以烟花算法(FWA)为基础,提出一种新框架,通过引入多模态大语言模型(MLLM)辅助优化过程,定义关键部分(CP)概念,扩展其处理复杂高维任务的能力。重点评估旅行商问题(TSP)与电子设计自动化问题(EDA)。实验表明,新框架生成的FWA在多个问题实例上达到或超越现有最优结果。

原文摘要 · Abstract (English)

As optimization problems grow increasingly complex and diverse, advancements in optimization techniques and paradigm innovations hold significant importance. The challenges posed by optimization problems are primarily manifested in their non-convexity, high-dimensionality, black-box nature, and other unfavorable characteristics. Traditional zero-order or first-order methods, which are often characterized by low efficiency, inaccurate gradient information, and insufficient utilization of optimization information, are ill-equipped to address these challenges effectively. In recent years, the rapid development of large language models (LLM) has led to substantial improvements in their language understanding and code generation capabilities. Consequently, the design of optimization algorithms leveraging large language models has garnered increasing attention from researchers. In this study, we choose the fireworks algorithm(FWA) as the basic optimizer and propose a novel approach to assist the design of the FWA by incorporating multi-modal large language model(MLLM). To put it simply, we propose the concept of Critical Part(CP), which extends FWA to complex high-dimensional tasks, and further utilizes the information in the optimization process with the help of the multi-modal characteristics of large language models. We focus on two specific tasks: the \textit{traveling salesman problem }(TSP) and \textit{electronic design automation problem} (EDA). The experimental results show that FWAs generated under our new framework have achieved or surpassed SOTA results on many problem instances.

优化算法多模态模型烟花算法智能优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。