通过动态分配多个智能体协作推理,提升隐含立场判断的准确性。
Multi-Agent Reasoning with Adaptive Worker Allocation for Stance Detection

- 用可变数量的智能体从不同视角分析文本,仅输出推理过程
- 在新冠立场数据集上达到86.07的宏观F1,显著优于传统方法
- 适合处理隐晦、依赖语境的立场判断任务,尤其适合复杂文本
立场检测需识别作者对目标的观点,常出现在短文本中,立场往往隐含、间接或修辞表达。尽管大语言模型表现良好,但单次提示易受多种解释影响而脆弱。现有聚合策略如多数投票或自一致性虽提升鲁棒性,却丢弃了化解矛盾解释所需的中间推理过程。本文提出一种多智能体推理框架,采用经理-工人架构,根据输入复杂度动态分配可变数量的工人智能体。每个工人从不同视角分析输入,仅输出推理说明而不给出立场标签;经理则整合这些推理生成最终预测。在SemEval-2016、P-Stance和COVID-19立场数据集上使用Llama、Mistral和Gemini进行评估。结果表明,该框架在隐含与上下文依赖的立场判断中提升最显著,在新冠数据集上达86.07宏观F1,SemEval-2016为82.90,同时在更明确的P-Stance上保持竞争力。这表明当无法仅凭表面线索可靠推断立场时,推理层面的动态聚合最具价值。
原文摘要 · Abstract (English)
Stance detection requires identifying an author's position toward a target, often from short-form texts where stance is implicit, indirect, or rhetorically framed. Although large language models (LLMs) achieve strong performance on this task, single-pass prompting can be brittle when multiple interpretations are plausible. Existing aggregation strategies, such as majority voting or self-consistency, improve robustness by combining labels, but they discard the intermediate reasoning needed to resolve conflicting interpretations. We introduce a multi-agent reasoning framework with adaptive worker allocation for stance detection that shifts aggregation from label-level voting to reasoning-level synthesis. The framework employs a Manager-Worker architecture in which a Manager adaptively allocates a variable number of Worker agents based on input complexity. Each Worker analyzes the input from a distinct perspective and produces a reasoning-only explanation without emitting a stance label; the Manager then synthesizes these explanations to produce the final prediction. We evaluate the proposed framework on SemEval-2016, P-Stance, and COVID-19 Stance using Llama, Mistral, and Gemini. Results show that the framework yields the largest gains on implicit and context-dependent stance cases, achieving 86.07 Macro-F1 on COVID-19 and 82.90 on SemEval-2016, while remaining competitive on more explicit stance datasets such as P-Stance. These findings suggest that adaptive reasoning-level aggregation is most beneficial when stance cannot be reliably inferred from surface cues alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。