arXiv:2504.11190cs.AIcs.CL2025-04被引 1

用知识图谱增强模型的隐含类比推理能力,让机器更懂隐喻。

Enhancing multimodal analogical reasoning with Logic Augmented Generation

  • 通过语义知识图谱与提示词结合,挖掘文本中的隐含类比关系
  • 在4个数据集上超越现有基线,视觉隐喻理解优于人类
  • 提升推理可解释性,适合需要深层语义理解的任务

大型语言模型在多种任务中展现出强大能力,但自动从自然语言中提取隐含知识仍面临挑战,因机器缺乏对物理世界的主动经验。为此,本文提出逻辑增强生成(LAG)框架,利用语义知识图谱显式表示文本,并结合提示启发式方法,激发隐含的类比关联。该方法生成扩展的知识图谱三元组以表征隐含意义,使系统能在无标签多模态数据上进行跨领域推理。我们在四个数据集上的三个隐喻检测与理解任务中验证了该方法,结果表明该集成方案优于当前基线,在视觉隐喻理解上甚至超过人类表现,且推理过程更具可解释性。然而,对特定领域隐喻的理解仍存在固有局限。此外,我们进行了详尽的错误分析,讨论了隐喻标注与评估方法存在的问题。

原文摘要 · Abstract (English)

Recent advances in Large Language Models have demonstrated their capabilities across a variety of tasks. However, automatically extracting implicit knowledge from natural language remains a significant challenge, as machines lack active experience with the physical world. Given this scenario, semantic knowledge graphs can serve as conceptual spaces that guide the automated text generation reasoning process to achieve more efficient and explainable results. In this paper, we apply a logic-augmented generation (LAG) framework that leverages the explicit representation of a text through a semantic knowledge graph and applies it in combination with prompt heuristics to elicit implicit analogical connections. This method generates extended knowledge graph triples representing implicit meaning, enabling systems to reason on unlabeled multimodal data regardless of the domain. We validate our work through three metaphor detection and understanding tasks across four datasets, as they require deep analogical reasoning capabilities. The results show that this integrated approach surpasses current baselines, performs better than humans in understanding visual metaphors, and enables more explainable reasoning processes, though still has inherent limitations in metaphor understanding, especially for domain-specific metaphors. Furthermore, we propose a thorough error analysis, discussing issues with metaphorical annotations and current evaluation methods.

类比推理知识图谱隐喻理解可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。