arXiv:2502.12845cs.LG2025-02被引 3

让大模型优化分子设计,能记住经验、高效探索、适应复杂反馈。

ExLLM: Experience-Enhanced LLM Optimization for Molecular Design and Beyond

  • 用可进化的小片段记录关键经验,避免重复,提升收敛速度。
  • 每次调用生成多个候选,扩大搜索范围,降低调度开销。
  • 自动处理专家提示和约束条件,适配多种设计任务。

分子设计面临巨大且不规则的搜索空间,传统优化方法如贝叶斯优化、遗传算法和生成模型难以融入专家知识或处理复杂反馈。近期大模型(LLM)作为优化器在PMO等基准上取得进展,但现有方法仅依赖提示或额外训练,缺乏处理复杂反馈和可扩展记忆的机制。常见做法是在每次查询后拼接或总结经验,导致冗余、探索能力下降,大规模迭代下最终结果不佳。本文提出ExLLM(Experience-Enhanced LLM optimization),一种以大模型为优化器的框架,包含三个组件:(1) 针对离散空间的紧凑、可演化经验片段,提炼非冗余线索,低开销提升收敛;(2) 简单有效的k-offspring策略,每次调用扩展多候选,减少协调成本;(3) 轻量级反馈适配器,统一目标归一化用于选择,格式化约束与专家提示供迭代。ExLLM在PMO上达到新最优,在圆盘排列和托卡马克设计中创纪录,并在仅需任务描述模板和评估函数的情况下,持续在多个领域表现提升。

原文摘要 · Abstract (English)

Molecular design involves an enormous and irregular search space, where traditional optimizers such as Bayesian optimization, genetic algorithms, and generative models struggle to leverage expert knowledge or handle complex feedback. Recently, LLMs have been used as optimizers, achieving promising results on benchmarks such as PMO. However, existing approaches rely only on prompting or extra training, without mechanisms to handle complex feedback or maintain scalable memory. In particular, the common practice of appending or summarizing experiences at every query leads to redundancy, degraded exploration, and ultimately poor final outcomes under large-scale iterative search. We introduce ExLLM (Experience-Enhanced LLM optimization), an LLM-as-optimizer framework with three components: (1) a compact, evolving experience snippet tailored to large discrete spaces that distills non-redundant cues and improves convergence at low cost; (2) a simple yet effective k-offspring scheme that widens exploration per call and reduces orchestration cost; and (3) a lightweight feedback adapter that normalizes objectives for selection while formatting constraints and expert hints for iteration. ExLLM sets new state-of-the-art results on PMO and generalizes strongly in our setup, it sets records on circle packing and stellarator design, and yields consistent gains across additional domains requiring only a task-description template and evaluation functions to transfer.

分子设计大模型优化智能搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。