用证据图结构让科研机器人自检逻辑,避免胡说八道。
EviGraph: Evidence-Guided Autonomous Research Agents

- 构建带类型节点的证据图,全程追踪研究命题与证据关系。
- 实验中提升主张支持率40.19%,数据一致性达87.73%。
- 适合追求可信自动科研的团队或需高可靠性论文生成的场景。
自主科研代理能提出假设、执行实验并撰写论文,但其输出常含无依据断言,且研究问题、实验、结果与结论间存在不一致。我们认为问题部分源于架构:现有系统将研究视为顺序流程,未显式维护各阶段间的演变证据结构。本文提出EviGraph,一种将研究过程表示为包含问题、缺口、假设、实验、发现和主张等节点的类型化证据图。该图作为代理的运行状态,而非事后记录。EviGraph可检测证据链中的缺失依赖、语义错位及结果与主张不一致,并定位最初始的薄弱节点,重新生成受影响的下游子图。通过图检查点机制防止失败修复污染已验证证据。仅当每个保留主张均有经验证的证据链支撑时才生成论文。在ARC-Bench-ML和NanoResearch-20上的实验表明,EviGraph优于对比的端到端科研代理基线,在整体研究性能上表现更优,主张支持率比最强基线提升40.19%,实验数据一致性达87.73%。结果证明显式维护证据状态对可靠自主科研的价值。
原文摘要 · Abstract (English)
Autonomous research agents can generate hypotheses, execute experiments, and draft manuscripts, yet their outputs often contain unsupported claims and inconsistencies between research questions, experiments, results, and conclusions. We argue that this problem is partly architectural: existing systems organize research as sequential pipelines but do not explicitly maintain or validate the evolving claim-evidence structure across stages. In this paper, we introduce EviGraph, an autonomous research framework that represents the research process as a typed evidence graph containing Problem, Gap, Hypothesis, Experiment, Finding, and Claim nodes. The graph serves as the operational state of the agent rather than a post-hoc record. EviGraph inspects evidence chains for missing dependencies, semantic misalignment, and result-claim inconsistencies, localizes the earliest weak node, and regenerates its affected downstream subgraph. Graph checkpointing prevents unsuccessful repairs from corrupting previously validated evidence. Manuscripts are generated only after every retained claim is grounded in a validated evidence chain. Experiments on ARC-Bench-ML and NanoResearch-20 show that EviGraph outperforms the compared end-to-end research-agent baselines in overall research performance, improves Claim Support Rate by 40.19% over the strongest baseline, and achieves 87.73% Experimental Data Consistency. These results demonstrate the value of explicit evidence-state maintenance for reliable autonomous research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。