用大模型自动简化难题,端到端设计高效求解算法
RedAHD: Reduction-Based End-to-End Automatic Heuristic Design with Large Language Models
- 用大模型自动将复杂问题转化为更易解的相似问题
- 在6个组合优化问题上表现优于或媲美现有方法
- 几乎无需人工干预,适合想快速部署求解器的研究者
求解实际中的NP难组合优化问题(如旅行商问题TSP、带容量的车辆路径问题CVRP)传统上依赖人工设计启发式算法或定义搜索空间来寻找有效解法。但这些方法需大量领域知识和实现成本。近年来,利用大语言模型(LLMs)在预设通用算法框架(GAF,如蚁群优化、引导局部搜索)内设计关键组件(如TSP/CVRP中每条边被选中的先验概率)已取得显著进展。然而,现有方法并非完全端到端,仍需大量人工干预。本文提出一种新框架RedAHD,使基于LLM的启发式设计无需GAF即可运行。RedAHD利用LLM自动化执行问题约简——将待解决的组合优化问题转化为更易理解的相似问题,并基于这些转化后问题设计有效启发式算法,从而间接求解原问题。在6个组合优化问题上的实验表明,RedAHD仅需极少人工参与,即可设计出性能与当前最优相当甚至更优的启发式算法。
原文摘要 · Abstract (English)
Solving NP-hard combinatorial optimization problems (COPs) (e.g., traveling salesman problems (TSPs) and capacitated vehicle routing problems (CVRPs)) in practice traditionally involves handcrafting heuristics or specifying a search space for finding effective heuristics. The main challenges from these approaches, however, are the sheer amount of domain knowledge and implementation efforts required from human experts. Recently, significant progress has been made to address these challenges, particularly by using large language models (LLMs) to design heuristics within some predetermined generalized algorithmic framework (GAF, e.g., ant colony optimization and guided local search) for building key functions/components (e.g., a priori information on how promising it is to include each edge in a solution for TSP and CVRP). Although existing methods leveraging this idea have shown to yield impressive optimization performance, they are not fully end-to-end and still require considerable manual interventions. In this paper, we propose a novel end-to-end framework, named RedAHD, that enables these LLM-based heuristic design methods to operate without the need of GAFs. More specifically, RedAHD employs LLMs to automate the process of reduction, i.e., transforming the COP at hand into similar COPs that are better-understood, from which LLM-based heuristic design methods can design effective heuristics for directly solving the transformed COPs and, in turn, indirectly solving the original COP. Our experimental results, evaluated on six COPs, show that RedAHD is capable of designing heuristics with competitive or improved results over the state-of-the-art methods with minimal human involvement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。