arXiv:2512.08609cs.AI2025-12被引 1

用大模型认知引导树搜索,自动优化启发式算法

CogMCTS: A Novel Cognitive-Guided Monte Carlo Tree Search Framework for Iterative Heuristic Evolution with Large Language Models

  • 将大模型认知反馈融入蒙特卡洛树搜索,多轮迭代优化启发式
  • 在多个优化问题上表现更稳定、高效且解质量更高
  • 适合需要自动设计启发式的复杂优化场景

自动启发式设计(AHD)是解决复杂优化问题的有效框架。大语言模型(LLMs)的出现使得启发式自动生成成为可能。现有基于LLM的进化方法依赖种群策略,易陷入局部最优。将LLM与蒙特卡洛树搜索(MCTS)结合可改善探索与利用的权衡,但多轮认知融合有限,搜索多样性不足。为此,本文提出一种新型认知引导的蒙特卡洛树搜索框架(CogMCTS)。该框架将大模型的认知引导机制与MCTS紧密结合,实现高效的自动化启发式优化。通过多轮认知反馈,融合历史经验、节点信息与负面结果,动态提升启发式生成能力。双轨节点扩展与精英启发式管理平衡了多样性的探索与高质量经验的利用。此外,策略性变异改变启发式形式与参数,进一步增强解的多样性与整体优化性能。实验表明,CogMCTS在稳定性、效率和解质量方面均优于现有基于LLM的AHD方法。

原文摘要 · Abstract (English)

Automatic Heuristic Design (AHD) is an effective framework for solving complex optimization problems. The development of large language models (LLMs) enables the automated generation of heuristics. Existing LLM-based evolutionary methods rely on population strategies and are prone to local optima. Integrating LLMs with Monte Carlo Tree Search (MCTS) improves the trade-off between exploration and exploitation, but multi-round cognitive integration remains limited and search diversity is constrained. To overcome these limitations, this paper proposes a novel cognitive-guided MCTS framework (CogMCTS). CogMCTS tightly integrates the cognitive guidance mechanism of LLMs with MCTS to achieve efficient automated heuristic optimization. The framework employs multi-round cognitive feedback to incorporate historical experience, node information, and negative outcomes, dynamically improving heuristic generation. Dual-track node expansion combined with elite heuristic management balances the exploration of diverse heuristics and the exploitation of high-quality experience. In addition, strategic mutation modifies the heuristic forms and parameters to further enhance the diversity of the solution and the overall optimization performance. The experimental results indicate that CogMCTS outperforms existing LLM-based AHD methods in stability, efficiency, and solution quality.

启发式设计大模型树搜索优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。