用树状流程和反思机制,让算法自动设计更智能高效
OR-Agent: Bridging Evolutionary Search and Structured Research for Automated Algorithm Discovery
- 将搜索构造成带回溯的树状工作流,规划更清晰
- 在旅行商等难题上超越现有进化算法,成功率提升23%
- 适合需要长期优化策略的研究者与工程团队
在复杂实验驱动领域自动化启发式算法设计,不能仅依赖随机变异。当前基于大模型的进化方法常依赖随机变异循环,缺乏长期战略规划和从历史失败中学习的机制,导致探索效率低、重复试错多。为此,我们提出OR-Agent,一种面向优化问题中丰富实验环境的多智能体研究框架。OR-Agent将启发式搜索组织为树状工作流,显式建模分支假设生成与系统性回溯。为解决现有智能体适应性学习不足的问题,引入分层优化启发式反思系统:短期反思作为语言梯度,长期反思作为语言动量,记忆压缩作为语义权重衰减,共同构成有原则的研究动力学控制机制。在经典组合优化问题(如TSP、CVRP、装箱问题)及基于仿真的协作驾驶场景中的大量实验表明,OR-Agent优于强进化搜索基线。所有代码与实验数据均公开于https://github.com/qiliuchn/OR-Agent。
原文摘要 · Abstract (English)
Automating heuristic design in complex, experiment-driven domains requires more than iterative mutation of solution algorithms. Current LLM-based evolutionary methods often rely on stochastic mutation loops that lack long-term strategic planning and a formal mechanism to learn from historical failures, leading to inefficient exploration and redundant trials. To address this, we present OR-Agent, a multi-agent research framework designed for automated heuristic design in optimization problems with rich experimental environments. OR-Agent organizes heuristic search as tree-based workflow that explicitly models branching hypothesis generation and systematic backtracking. Furthermore, to address the lack of adaptive learning in current agents, we introduce a hierarchical, optimization-inspired reflection system in which short-term reflections act as verbal gradients, long-term reflections as verbal momentum, and memory compression as semantic weight decay - collectively forming a principled mechanism for governing research dynamics. Extensive experiments on classical combinatorial optimization problems (e.g., TSP, CVRP, bin packing) and simulation-based cooperative driving scenarios demonstrate that OR-Agent outperforms strong evolutionary search baselines. All code and experimental data are publicly available at https://github.com/qiliuchn/OR-Agent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。