让大模型像人一样做因果推理,先找必要原因再考虑心理因素。
HCR-Reasoner: Synergizing Large Language Models and Theory for Human-like Causal Reasoning
- 分两步走:先用因果理论筛选必要原因,再用心理因素确定最终判断。
- 在1093个实例的评测中,模型与人类判断一致率显著提升。
- 适合研究可解释性AI、认知科学与大模型融合的学者。
真正的类人因果推理是强人工智能的基础。人类通常先判断事件是否属于因果链,再受道德、常态和意图等心理因素影响做出最终判断。这一过程对应于实际因果性理论(提供因果链成员资格的形式化)和认知科学中的因果判断研究(分析心理调节因素)。然而,这两个领域长期孤立发展,缺乏基于大语言模型的系统性方法。为此,我们提出HCR-Reasoner框架,将实际因果性理论与因果判断机制整合进大模型,模拟人类推理过程:先用形式化方法筛选结构上必要的候选原因,再通过心理因素确定最终选择的原因。为实现细粒度评估,我们构建了包含1,093个标注实例的HCR-Bench基准,涵盖详细推理步骤。实验表明,HCR-Reasoner能持续且显著提升大模型与人类在因果判断上的一致性,证明将理论引导的推理显式融入大模型对实现忠实的人类类因果推理极为有效。
原文摘要 · Abstract (English)
Genuine human-like causal reasoning is fundamental for strong artificial intelligence. Humans typically identify whether an event is part of the causal chain first, and then influenced by modulatory factors such as morality, normality, and intention to make the final judgment. These two stages naturally map to the fields of 1) actual causality that provides formalisms for causal chain membership and 2) causal judgment from cognitive science that studies psychological modulators that influence causal selection. However, these two domains have largely been studied in isolation, leaving a gap for a systematic method based on LLMs. Therefore, we introduce HCR-Reasoner, a framework that systematically integrates the theory of actual causality and causal judgment into LLMs for human-like causal reasoning. It simulates humans by using actual causality formalisms to filter for structurally necessary candidate causes and causal judgment factors to determine the psychologically selected cause. For fine-grained evaluation, we introduce HCR-Bench, a challenging benchmark with 1,093 annotated instances with detailed reasoning steps. Results show HCR-Reasoner consistently and significantly improves LLMs' causal alignment with humans, and that explicitly integrating theory-guided reasoning into LLMs is highly effective for achieving faithful human-like causal reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。