用大模型模拟专家会议,自动识别各方共识
Finding Common Ground: Using Large Language Models to Detect Agreement in Multi-Agent Decision Conferences
- 构建多智能体系统,用大模型模拟专家讨论并检测立场
- 六种大模型在立场与情感检测任务中表现稳定,准确识别共识
- 可提升讨论效率,适用于政策制定等需要集体决策的场景
决策会议是召集跨领域专家共同讨论复杂问题并达成行动或政策建议共识的结构化协作会议。近年来,大语言模型(LLMs)在模拟真实场景方面展现出巨大潜力,尤其通过多智能体系统模拟群体互动。本文提出一种基于大模型的多智能体系统,专门用于模拟决策会议,并聚焦于检测参与者智能体之间的意见一致。我们评估了六种不同大模型在两项任务上的表现:立场检测(判断智能体对议题的立场)和立场极性检测(判断情感为正、负或中立)。这些模型在多智能体系统中进一步被测试,以评估其在复杂模拟中的有效性。结果表明,大模型能在动态且复杂的辩论中可靠地检测共识。在系统中引入共识检测智能体,可提升群体讨论效率,并增强讨论的整体质量与连贯性,使模拟结果与真实决策会议相当。研究证明,基于大模型的多智能体系统具备模拟群体决策过程的潜力,未来可在专家征询工作坊等多领域中支持决策制定。
原文摘要 · Abstract (English)
Decision conferences are structured, collaborative meetings that bring together experts from various fields to address complex issues and reach a consensus on recommendations for future actions or policies. These conferences often rely on facilitated discussions to ensure productive dialogue and collective agreement. Recently, Large Language Models (LLMs) have shown significant promise in simulating real-world scenarios, particularly through collaborative multi-agent systems that mimic group interactions. In this work, we present a novel LLM-based multi-agent system designed to simulate decision conferences, specifically focusing on detecting agreement among the participant agents. To achieve this, we evaluate six distinct LLMs on two tasks: stance detection, which identifies the position an agent takes on a given issue, and stance polarity detection, which identifies the sentiment as positive, negative, or neutral. These models are further assessed within the multi-agent system to determine their effectiveness in complex simulations. Our results indicate that LLMs can reliably detect agreement even in dynamic and nuanced debates. Incorporating an agreement-detection agent within the system can also improve the efficiency of group debates and enhance the overall quality and coherence of deliberations, making them comparable to real-world decision conferences regarding outcome and decision-making. These findings demonstrate the potential for LLM-based multi-agent systems to simulate group decision-making processes. They also highlight that such systems could be instrumental in supporting decision-making with expert elicitation workshops across various domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。