提出EoG框架,用图结构提升大模型在复杂调查中的推理稳定性与准确性。
Think Locally, Explain Globally: Graph-Guided LLM Investigations via Local Reasoning and Belief Propagation
- 构建依赖图,分拆局部推理与全局信念传播,避免信息丢失
- 在ITBench任务上实现7倍于ReAct的多数判定准确率提升
- 适合需要高一致性和可解释性的故障诊断等开放调查场景
大模型代理在静态环境和上下文有限时表现良好,但在开放式调查中常因需从海量异构数据中迭代挖掘证据而失败。此类调查存在隐藏依赖结构:实体相互作用、信号共变,事实重要性需待后续证据揭示。受限于上下文窗口,代理必须提前总结中间发现,易误删关键信息。传统ReAct代理在此类任务中尤为脆弱,其检索-总结-推理循环对探索顺序敏感,导致结果不稳定,尽管通过多次采样或延长推理链仍无法可靠稳定输出。原因在于假设无法随新证据自主验证,且缺乏显式信念记录与修正机制。此外,ReAct将语义推理与工具调度、状态追踪耦合,执行错误与计划漂移会削弱推理能力并消耗宝贵上下文。为此,本文将调查建模为依赖图上的溯因推理,提出EoG(Explanations over Graphs)框架:由大模型负责局部证据挖掘与标注(原因/症状),由确定性控制器管理遍历、状态与信念传播,以计算最小解释前沿。在代表性ITBench诊断任务上,EoG显著优于ReAct基线,不仅提升准确率,更大幅增强运行间一致性,多数判定(Majority-at-k)实体F1提升达7倍。
原文摘要 · Abstract (English)
LLM agents excel when environments are mostly static and the needed information fits in a model's context window, but they often fail in open-ended investigations where explanations must be constructed by iteratively mining evidence from massive, heterogeneous operational data. These investigations exhibit hidden dependency structure: entities interact, signals co-vary, and the importance of a fact may only become clear after other evidence is discovered. Because the context window is bounded, agents must summarize intermediate findings before their significance is known, increasing the risk of discarding key evidence. ReAct-style agents are especially brittle in this regime. Their retrieve-summarize-reason loop makes conclusions sensitive to exploration order and introduces run-to-run non-determinism, producing a reliability gap where Pass-at-k may be high but Majority-at-k remains low. Simply sampling more rollouts or generating longer reasoning traces does not reliably stabilize results, since hypotheses cannot be autonomously checked as new evidence arrives and there is no explicit mechanism for belief bookkeeping and revision. In addition, ReAct entangles semantic reasoning with controller duties such as tool orchestration and state tracking, so execution errors and plan drift degrade reasoning while consuming scarce context. We address these issues by formulating investigation as abductive reasoning over a dependency graph and proposing EoG (Explanations over Graphs), a disaggregated framework in which an LLM performs bounded local evidence mining and labeling (cause vs symptom) while a deterministic controller manages traversal, state, and belief propagation to compute a minimal explanatory frontier. On a representative ITBench diagnostics task, EoG improves both accuracy and run-to-run consistency over ReAct baselines, including a 7x average gain in Majority-at-k entity F1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。