用大模型抽象叙事结构,提升机器类比推理能力
Enhancing Structural Mapping with LLM-derived Abstractions for Analogical Reasoning in Narratives
- 通过大模型分解并抽象叙事单元,构建可映射的结构化表示
- 在多个数据集上表现优于端到端大模型基线,提升类比推理准确率
- 适合研究叙事理解、类比推理与认知建模的研究者
类比推理是人类解决问题和论证中实现泛化的核心能力,但机器在叙事结构间的类比仍面临挑战。现有认知映射模型依赖预提取实体,而大模型性能受提示格式和表面相似性影响显著。为此,本文提出YARN框架,利用大模型将叙事分解为单元,进行四层次抽象(基于框架理论),再通过映射组件实现跨故事元素对齐与类比推理。实验表明,抽象显著提升模型性能,达到或超过端到端大模型基线。误差分析揭示当前在恰当抽象层级、隐含因果关系捕捉及叙事类比模式分类方面仍存挑战。YARN支持模块化实验设计,代码已开源,便于后续研究。
原文摘要 · Abstract (English)
Analogical reasoning is a key driver of human generalization in problem-solving and argumentation. Yet, analogies between narrative structures remain challenging for machines. Cognitive engines for structural mapping are not directly applicable, as they assume pre-extracted entities, whereas LLMs' performance is sensitive to prompt format and the degree of surface similarity between narratives. This gap motivates a key question: What is the impact of enhancing structural mapping with LLM-derived abstractions on their analogical reasoning ability in narratives? To that end, we propose a modular framework named YARN (Yielding Abstractions for Reasoning in Narratives), which uses LLMs to decompose narratives into units, abstract these units, and then passes them to a mapping component that aligns elements across stories to perform analogical reasoning. We define and operationalize four levels of abstraction that capture both the general meaning of units and their roles in the story, grounded in prior work on framing. Our experiments reveal that abstractions consistently improve model performance, resulting in competitive or better performance than end-to-end LLM baselines. Closer error analysis reveals the remaining challenges in abstraction at the right level, in incorporating implicit causality, and an emerging categorization of analogical patterns in narratives. YARN enables systematic variation of experimental settings to analyze component contributions, and to support future work, we make the code for YARN openly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。