arXiv:2509.21193cs.CLcs.AI2025-09被引 11

用隐式检索与分层协作提升科学推理,准确率超现有模型18.1点

Eigen-1: Adaptive Multi-Agent Refinement with Monitor-Based RAG for Scientific Reasoning

  • 以监控模块实现逐词级隐式知识融合,减少显式检索开销
  • 在HLE生物/化学测试中达48.3%准确率,优于最强基线13.4点
  • 适合需要高效高精度推理的科研与教育场景

大型语言模型在科学推理任务上取得进展,但仍面临两大瓶颈:显式检索会打断推理流程,带来额外的token和步骤开销;多智能体管道常因平均所有候选解而稀释优质方案。本文提出统一框架,融合隐式检索与结构化协作。底层采用基于监控的检索模块,在词元级别整合外部知识,对推理干扰最小。在此基础上,层级解精炼(HSR)迭代地将每个候选解作为锚点,由同伴修复;质量感知迭代推理(QAIR)根据解的质量动态调整精炼过程。在人类最后考试(HLE)生物/化学黄金数据集上,本框架达到48.3%准确率,为目前最高纪录,比最强智能体基线高出13.4分,领先前沿LLM达18.1分,同时减少53.5%的token消耗和43.7%的智能体步骤。在SuperGPQA和TRQA上的结果验证了跨领域鲁棒性。错误分析显示,推理失败与知识缺口在超过85%的案例中同时出现;多样性分析揭示:检索任务受益于解的多样性,而推理任务更偏好共识。这些发现表明,隐式增强与结构化精炼可有效克服显式工具使用和均匀聚合的低效问题。代码已开源:https://github.com/tangxiangru/Eigen-1。

原文摘要 · Abstract (English)

Large language models (LLMs) have recently shown strong progress on scientific reasoning, yet two major bottlenecks remain. First, explicit retrieval fragments reasoning, imposing a hidden "tool tax" of extra tokens and steps. Second, multi-agent pipelines often dilute strong solutions by averaging across all candidates. We address these challenges with a unified framework that combines implicit retrieval and structured collaboration. At its foundation, a Monitor-based retrieval module operates at the token level, integrating external knowledge with minimal disruption to reasoning. On top of this substrate, Hierarchical Solution Refinement (HSR) iteratively designates each candidate as an anchor to be repaired by its peers, while Quality-Aware Iterative Reasoning (QAIR) adapts refinement to solution quality. On Humanity's Last Exam (HLE) Bio/Chem Gold, our framework achieves 48.3\% accuracy -- the highest reported to date, surpassing the strongest agent baseline by 13.4 points and leading frontier LLMs by up to 18.1 points, while simultaneously reducing token usage by 53.5\% and agent steps by 43.7\%. Results on SuperGPQA and TRQA confirm robustness across domains. Error analysis shows that reasoning failures and knowledge gaps co-occur in over 85\% of cases, while diversity analysis reveals a clear dichotomy: retrieval tasks benefit from solution variety, whereas reasoning tasks favor consensus. Together, these findings demonstrate how implicit augmentation and structured refinement overcome the inefficiencies of explicit tool use and uniform aggregation. Code is available at: https://github.com/tangxiangru/Eigen-1.

科学推理多智能体隐式检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。