arXiv:2511.06727cs.MAcs.AI2025-11AAAI被引 8

按主题构建协作图,让多模型分工解决跨领域难题

S-DAG: A Subject-Based Directed Acyclic Graph for Multi-Agent Heterogeneous Reasoning

  • 用图神经网络生成主题依赖关系图,指导模型分工
  • 在多个基准上准确率超越现有方法12%-18%以上
  • 适合需要多领域知识融合的复杂推理任务

大语言模型在复杂推理任务中表现优异,但其效果高度依赖任务所涉领域知识。现有方法如专家混合模型通常在任务层面操作,难以有效处理涉及多个主题的异构问题。本文提出一种新框架,在主题层面进行细粒度分析,并设计专门的多智能体协作策略以应对异构问题推理。具体而言,输入查询后,首先利用图神经网络识别相关主题并推断其依赖关系,生成主题导向的有向无环图(S-DAG),其中节点代表主题,边表示信息流。随后,为每个大模型分配主题专属专长评分,并为S-DAG中每个主题匹配表现最优的模型。这种主题-模型匹配实现图结构化的多智能体协作,信息沿S-DAG从起点流向终点。我们构建并发布了标准基准(MMLU-Pro、GPQA、MedMCQA)的多主题子集,更真实反映复杂现实推理任务。大量实验表明,该方法在准确率与效率上显著优于现有任务级模型选择和多智能体协作基线。结果验证了主题感知推理与结构化协作在处理复杂多主题问题中的有效性。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have achieved impressive performance in complex reasoning problems. Their effectiveness highly depends on the specific nature of the task, especially the required domain knowledge. Existing approaches, such as mixture-of-experts, typically operate at the task level; they are too coarse to effectively solve the heterogeneous problems involving multiple subjects. This work proposes a novel framework that performs fine-grained analysis at subject level equipped with a designated multi-agent collaboration strategy for addressing heterogeneous problem reasoning. Specifically, given an input query, we first employ a Graph Neural Network to identify the relevant subjects and infer their interdependencies to generate an \textit{Subject-based Directed Acyclic Graph} (S-DAG), where nodes represent subjects and edges encode information flow. Then we profile the LLM models by assigning each model a subject-specific expertise score, and select the top-performing one for matching corresponding subject of the S-DAG. Such subject-model matching enables graph-structured multi-agent collaboration where information flows from the starting model to the ending model over S-DAG. We curate and release multi-subject subsets of standard benchmarks (MMLU-Pro, GPQA, MedMCQA) to better reflect complex, real-world reasoning tasks. Extensive experiments show that our approach significantly outperforms existing task-level model selection and multi-agent collaboration baselines in accuracy and efficiency. These results highlight the effectiveness of subject-aware reasoning and structured collaboration in addressing complex and multi-subject problems.

多智能体主题建模推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。