用多智能体协作让大模型回答更准,减少幻觉。
AMATA: Adaptive Multi-Agent Trajectory Alignment for Knowledge-Intensive Question Answering

- 六类专用智能体协同推理,动态整合外部知识。
- 在五个基准上表现优于现有方法,节省计算资源。
- 通过偏好对齐提升关键智能体作用,适合复杂问答场景。
尽管大型语言模型(LLMs)取得显著进展,但在需要密集知识的问答任务中生成事实一致的回答仍具挑战性,主要源于幻觉及长尾知识缺口。为此,我们提出AMATA——一种自适应多智能体轨迹对齐框架,通过动态整合外部知识来提升响应的可解释性与事实依据。该架构利用六个专业智能体协同执行复杂问题推理的结构化动作,并将多智能体与外部工具协作形式化为轨迹偏好对齐问题,引入问题感知的智能体定制和跨智能体偏好调和机制。AMATA包含两项核心创新:(1) 轨迹内偏好学习,以目标为导向识别关键智能体;(2) 智能体间依赖学习,通过新型依赖感知的直接偏好优化技术捕捉跨智能体工具依赖关系。实证结果表明,AMATA在五个主流知识密集型问答基准上持续优于基线方法、知识增强框架及基于LLM的轨迹系统。进一步分析显示,该方法在降低令牌消耗方面具有显著效率优势。
原文摘要 · Abstract (English)
Despite substantial advances in large language models (LLMs), generating factually consistent responses for knowledge-intensive question answering remains challenging. These difficulties are primarily due to hallucinations and the limitations of LLMs in bridging long-tail knowledge gaps. To address this, we propose AMATA, an Adaptive Multi-Agent Trajectory Alignment framework that dynamically integrates external knowledge to improve response interpretability and factual grounding. Our architecture leverages six specialized agents that collaboratively perform structured actions for complex question reasoning. We formalize multi-agent collaboration with external tools as a trajectory preference alignment problem, incorporating question-aware agent customization and inter-agent preference harmonization. AMATA introduces two principal innovations: (1) Intra-Trajectory Preference Learning, which learns objective-oriented preferences to prioritize critical agents, and (2) Inter-Agent Dependency Learning, which captures cross-agent tool dependencies through a novel dependency-aware direct preference optimization technique. Empirical results show that AMATA consistently outperforms baseline approaches, knowledge-augmented frameworks, and LLM-based trajectory systems on five established knowledge-intensive QA benchmarks. Further analysis demonstrates the efficiency of our method in reducing token consumption.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。