用多模态大模型结合图结构优化,提升组合问题求解质量与可靠性。
Structure-Aware Cooperative Ensemble Evolutionary Optimization on Combinatorial Problems with Multimodal Large Language Models
- 用图像编码保留图结构上下文,让大模型理解网络拓扑。
- 通过图稀疏化简化复杂网络,保持关键结构特征。
- 多布局投票集成策略,降低大模型对排版的敏感性。
进化算法在探索图结构组合问题的大解空间方面表现优异。然而,传统的二进制或数值编码难以直接捕捉网络的复杂结构特性。本文采用基于图像的编码方式以保留拓扑上下文,并利用多模态大语言模型(MLLMs)作为进化算子,实现对图数据的结构感知优化。为应对大规模网络可视化带来的视觉杂乱问题,我们引入图稀疏化技术,在保留关键结构特征的前提下简化结构。为进一步提升鲁棒性并缓解不同稀疏化视角带来的偏差,提出一种协作式进化优化框架,支持跨域知识迁移,并统一多种稀疏化变体的结构表示。同时,考虑到MLLMs对网络布局的敏感性,设计了一种集成策略,通过共识投票聚合多种布局配置下的输出。在真实世界网络上的多项任务实验表明,该方法显著提升了MLLM驱动进化优化中解的质量与可靠性。
原文摘要 · Abstract (English)
Evolutionary algorithms (EAs) have proven effective in exploring the vast solution spaces typical of graph-structured combinatorial problems. However, traditional encoding schemes, such as binary or numerical representations, often fail to straightforwardly capture the intricate structural properties of networks. Through employing the image-based encoding to preserve topological context, this study utilizes multimodal large language models (MLLMs) as evolutionary operators to facilitate structure-aware optimization over graph data. To address the visual clutter inherent in large-scale network visualizations, we leverage graph sparsification techniques to simplify structures while maintaining essential structural features. To further improve robustness and mitigate bias from different sparsification views, we propose a cooperative evolutionary optimization framework that facilitates cross-domain knowledge transfer and unifies multiple sparsified variants of diverse structures. Additionally, recognizing the sensitivity of MLLMs to network layout, we introduce an ensemble strategy that aggregates outputs from various layout configurations through consensus voting. Finally, experiments on real-world networks through various tasks demonstrate that our approach improves both the quality and reliability of solutions in MLLM-driven evolutionary optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。