测试大模型能否可靠优化网络组合问题,发现其有潜力但需纠错机制。
Can Large Language Models Be Trusted as Evolutionary Optimizers for Network-Structured Combinatorial Problems?
- 用进化算法框架评估大模型生成解的约束符合度
- 引入纠错机制后解的质量提升,且群体优化更高效
- 适合对可解释性要求高的网络优化场景
大型语言模型(LLMs)在语言理解与推理方面表现出色,近期被探索用于作为网络结构组合优化问题的主要求解器。然而,在实际部署前必须回答一个根本问题:LLMs能否在迭代过程中持续生成满足问题约束的解?本文提出系统性评估框架,不将模型视为黑箱生成器,而是基于常见进化优化器(EVO),严谨评估基于大模型的操作符在进化各阶段的输出保真度。为增强鲁棒性,设计了混合纠错机制以缓解输出不确定性。此外,探索了一种成本高效的群体级优化策略,相比传统个体级方法显著提升效率。在代表性节点级网络组合优化任务上的大量实验表明,基于大模型的进化优化具备有效性、适应性及内在局限性。研究为大模型融入进化计算提供了视角,并探讨了支持可扩展、上下文感知优化的路径。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have shown strong capabilities in language understanding and reasoning across diverse domains. Recently, there has been increasing interest in utilizing LLMs not merely as assistants in optimization tasks, but as primary optimizers, particularly for network-structured combinatorial problems. However, before LLMs can be reliably deployed in this role, a fundamental question must be addressed: Can LLMs iteratively manipulate solutions that consistently adhere to problem constraints? In this work, we propose a systematic framework to evaluate the capability of LLMs to engage with problem structures. Rather than treating the model as a black-box generator, we adopt the commonly used evolutionary optimizer (EVO) and propose a comprehensive evaluation framework that rigorously assesses the output fidelity of LLM-based operators across different stages of the evolutionary process. To enhance robustness, we introduce a hybrid error-correction mechanism that mitigates uncertainty in LLMs outputs. Moreover, we explore a cost-efficient population-level optimization strategy that significantly improves efficiency compared to traditional individual-level approaches. Extensive experiments on a representative node-level combinatorial network optimization task demonstrate the effectiveness, adaptability, and inherent limitations of LLM-based EVO. Our findings present perspectives on integrating LLMs into evolutionary computation and discuss paths that may support scalable and context-aware optimization in networked systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。