用群体智能提升大模型推理,让多个AI agent协作找最优解。
Swarm Intelligence Enhanced Reasoning: A Density-Driven Framework for LLM-Based Multi-Agent Optimization
- 将大模型推理建模为优化问题,用群体智能引导多代理协同搜索。
- 通过密度估计与非支配排序,同时提升解的质量和多样性。
- 动态阈值控制终止条件,适合复杂问题求解与高阶推理任务。
近年来,链式思维提示(CoT)和多代理辩论(MAD)等方法被提出以增强大语言模型(LLMs)在推理场景中的复杂问题求解能力。然而,这些方法可能因缺乏寻找最优解的能力而失效。群体智能在传统优化问题中已被证明是寻找最优解的强大工具。为此,我们提出将群体智能融入推理过程,引入一种新型基于代理的群体智能(ASI)范式。该范式将LLM推理建模为优化问题,并利用群体智能方案引导一组基于LLM的代理协同搜索最优解。为避免陷入局部最优,我们进一步提出群体智能增强推理(SIER)框架,采用密度驱动策略提升推理能力。具体而言,通过核密度估计与非支配排序,同时优化解的质量与多样性。该机制通过扩展推理路径的多样性,高效增强解空间探索。此外,采用步级质量评估,帮助代理通过修正低质量中间步骤来提升解的质量。通过质量阈值动态控制探索终止与候选步骤选择,实现更灵活高效的推理过程。大量实验验证了该方法的有效性。
原文摘要 · Abstract (English)
Recently, many approaches, such as Chain-of-Thought (CoT) prompting and Multi-Agent Debate (MAD), have been proposed to further enrich Large Language Models' (LLMs) complex problem-solving capacities in reasoning scenarios. However, these methods may fail to solve complex problems due to the lack of ability to find optimal solutions. Swarm Intelligence has been serving as a powerful tool for finding optima in the field of traditional optimization problems. To this end, we propose integrating swarm intelligence into the reasoning process by introducing a novel Agent-based Swarm Intelligence (ASI) paradigm. In this paradigm, we formulate LLM reasoning as an optimization problem and use a swarm intelligence scheme to guide a group of LLM-based agents in collaboratively searching for optimal solutions. To avoid swarm intelligence getting trapped in local optima, we further develop a Swarm Intelligence Enhancing Reasoning (SIER) framework, which develops a density-driven strategy to enhance the reasoning ability. To be specific, we propose to perform kernel density estimation and non-dominated sorting to optimize both solution quality and diversity simultaneously. In this case, SIER efficiently enhances solution space exploration through expanding the diversity of the reasoning path. Besides, a step-level quality evaluation is used to help agents improve solution quality by correcting low-quality intermediate steps. Then, we use quality thresholds to dynamically control the termination of exploration and the selection of candidate steps, enabling a more flexible and efficient reasoning process. Extensive experiments are ...
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。