用大模型与小模型协作,让药物设计更高效
MCCE: A Framework for Multi-LLM Collaborative Search in Discrete Spaces with Similarity-Filtered Preference Learning
- 大模型负责探索,小模型持续学习,二者互为补充
- 在药物设计任务中,优化结果达到当前最好水平
- 适合需要长期迭代优化的科研场景
多目标离散优化问题(如分子设计)因组合空间巨大且无结构而极具挑战。传统进化算法易陷入局部最优,而专家知识可显著加速收敛。大型语言模型(LLMs)具备强大先验和推理能力,是依赖专家知识优化的理想工具。然而,闭源大模型无法更新参数,难以积累经验;小型开源模型虽可不断微调,但知识广度和推理能力不足。我们提出多大模型协同共进化框架(MCCE),将冻结的闭源大模型与轻量可训练模型结合。系统维护历史搜索轨迹,通过强化学习逐步优化小模型,两者在全局探索中协同互补。不同于模型蒸馏,该过程通过相互启发提升双方能力。在多目标药物设计基准测试中,MCCE实现了最先进的帕累托前沿质量,持续优于基线方法。结果揭示了一种新型混合大模型系统持续演化的范式,融合了知识驱动的探索与经验驱动的学习。
原文摘要 · Abstract (English)
Multi-objective discrete optimization problems, such as molecular design, pose significant challenges due to their vast and unstructured combinatorial spaces. Traditional evolutionary algorithms often get trapped in local optima, while expert knowledge can provide crucial guidance for accelerating convergence. Large language models (LLMs) offer powerful priors and reasoning ability, making them natural optimizers when expert knowledge matters. However, closed-source LLMs, though strong in exploration, cannot update their parameters and thus cannot internalize experience. Conversely, smaller open models can be continually fine-tuned but lack broad knowledge and reasoning strength. We introduce Multi-LLM Collaborative Co-evolution (MCCE), a hybrid framework that unites a frozen closed-source LLM with a lightweight trainable model. The system maintains a trajectory memory of past search processes; the small model is progressively refined via reinforcement learning, with the two models jointly supporting and complementing each other in global exploration. Unlike model distillation, this process enhances the capabilities of both models through mutual inspiration. Experiments on multi-objective drug design benchmarks show that MCCE achieves state-of-the-art Pareto front quality and consistently outperforms baselines. These results highlight a new paradigm for enabling continual evolution in hybrid LLM systems, combining knowledge-driven exploration with experience-driven learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。