用专家协作生成因果图,提升大模型事件推理能力
Causal Graph based Event Reasoning using Semantic Relation Experts
- 让大模型模拟不同语义关系专家,多轮讨论生成因果图
- 无需微调,在事件预测和时间线任务上达到顶尖水平
- 生成可解释的因果链,适合需要透明推理的应用
理解场景中事件之间的因果联系对建模和推理至关重要,但当前大语言模型在识别事件因果关系上仍表现不佳,导致事件预测与时间线理解等深层任务效果受限。为解决此问题,本文探索将因果事件图(如A促成B)作为并行机制,帮助大模型在推理时显式表达因果关系。提出一种协作式因果图生成方法:利用大模型模拟专注于特定语义关系的专家,通过多轮讨论后由最终专家整合结果。实验表明,该因果图可有效支持下游任务,且引入新的可解释事件预测任务,要求生成包含因果链的解释。相比基线,新方法生成的解释更具信息量和连贯性。整体方法未在任何下游任务上微调,但在事件预测与未来事件预测任务上达到先进水平。
原文摘要 · Abstract (English)
Understanding how events in a scenario causally connect with each other is important for effectively modeling and reasoning about events. But event reasoning remains a difficult challenge, and despite recent advances, Large Language Models (LLMs) still struggle to accurately identify causal connections between events. This struggle leads to poor performance on deeper reasoning tasks like event forecasting and timeline understanding. To address this challenge, we investigate the generation of causal event graphs (e.g., A enables B) as a parallel mechanism to help LLMs explicitly represent causality during inference. This paper evaluates both how to generate correct graphs as well as how graphs can assist reasoning. We propose a collaborative approach to causal graph generation where we use LLMs to simulate experts that focus on specific semantic relations. The experts engage in multiple rounds of discussions which are then consolidated by a final expert. Then, to demonstrate the utility of causal graphs, we use them on multiple downstream applications, and also introduce a new explainable event prediction task that requires a causal chain of events in the explanation. These explanations are more informative and coherent than baseline generations. Finally, our overall approach not finetuned on any downstream task, achieves competitive results with state-of-the-art models on both forecasting and next event prediction tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。