arXiv:2609.01608cs.LGcs.AI2026-09

用预测-行动世界模型,让优化代理自动进化,提升样本效率。

WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modeling

论文配图:WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modeling
图 1 · 摘自论文原文
  • 先预测优化方向,再生成候选解,减少盲目试错。
  • 在分子多目标优化中,有限评估预算下达到顶尖性能。
  • 适合需要高效探索高维空间的自动化优化场景。

黑箱优化问题因搜索空间大、结构弱且维度高而难以解决。现有方法常因依赖直接生成候选或试错修正,导致样本效率低下。通过世界建模可提前识别有前景的优化方向,从而提升效率。大语言模型凭借隐含知识,能对候选解结果做出非平凡准确的预测。受此启发,我们提出WMLLM,一种基于预测-行动世界建模的自演化优化代理框架。该代理先预测有潜力的方向,再执行生成候选。结合代理多轮精炼、种群搜索与强化学习,WMLLM在搜索过程中同时优化其隐式世界模型和优化策略。在黑箱优化任务上的实验,特别是多目标分子优化,表明WMLLM显著提升了样本效率与最终性能。在多目标分子优化基准测试中,有限评估预算下取得当前最优结果。

原文摘要 · Abstract (English)

Black-box optimization problems remain challenging because of large, weakly structured, and high-dimensional search spaces. Existing methods often suffer from poor sample efficiency because they rely on direct candidate generation or trial-and-error refinement. A natural way to improve search efficiency is to use world modeling, which can help identify promising optimization directions before costly evaluation. Large language models can predict the outcomes of these candidates with nontrivial accuracy because of their implicit knowledge. Motivated by this observation, we propose WMLLM, a self-evolving optimization-agent framework based on predict-then-act world modeling. The agent first predicts promising directions and then acts to generate candidates. Combined with agentic multi-turn refinement, population-based search, and reinforcement learning, WMLLM refines both its implicit world model and its optimization strategy during search. Experiments on black-box optimization tasks, especially multi-objective molecular optimization, show that WMLLM improves sample efficiency and final optimization performance. On the multi-objective molecular optimization benchmark, WMLLM achieves state-of-the-art results under a limited evaluation budget.

优化代理世界建模分子设计自演化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。