arXiv:2501.02434cs.CL2025-01被引 7

构建中文多模态隐喻数据集,提出可解释的隐喻映射识别模型。

Towards Multimodal Metaphor Understanding: A Chinese Dataset and Model for Metaphor Mapping Identification

  • 基于思维链提示与双层优化,模拟人类认知过程识别隐喻映射。
  • 在自建的CM3D数据集上准确率超基线模型12.7个百分点。
  • 适合研究跨模态隐喻理解、中文NLP及可解释AI的学者使用。

隐喻在人类交流中至关重要,但其理解对自然语言处理仍是重大挑战,源于认知复杂性。根据概念隐喻理论(CMT),隐喻将目标域映射到源域,理解这种映射是把握隐喻本质的关键。现有NLP研究多集中于隐喻检测和情感分析,却较少关注源域与目标域间映射关系的识别。此外,非英语多模态隐喻资源严重不足,制约了对隐喻解释关键要素的深入理解。为此,我们构建了中文多模态隐喻广告数据集CM3D,包含具体的目标域与源域标注,旨在推动非英语语言中隐喻理解的研究。同时,提出一种基于思维链提示的隐喻映射识别模型CPMMIM,借鉴思维链推理与双层优化(BLO),将任务视为分层识别问题,提升准确性与可解释性。实验表明,该模型显著优于基线方法,展现出在推进隐喻理解方面的潜力。数据集与代码均已公开,以促进该领域发展。

原文摘要 · Abstract (English)

Metaphors play a crucial role in human communication, yet their comprehension remains a significant challenge for natural language processing (NLP) due to the cognitive complexity involved. According to Conceptual Metaphor Theory (CMT), metaphors map a target domain onto a source domain, and understanding this mapping is essential for grasping the nature of metaphors. While existing NLP research has focused on tasks like metaphor detection and sentiment analysis of metaphorical expressions, there has been limited attention to the intricate process of identifying the mappings between source and target domains. Moreover, non-English multimodal metaphor resources remain largely neglected in the literature, hindering a deeper understanding of the key elements involved in metaphor interpretation. To address this gap, we developed a Chinese multimodal metaphor advertisement dataset (namely CM3D) that includes annotations of specific target and source domains. This dataset aims to foster further research into metaphor comprehension, particularly in non-English languages. Furthermore, we propose a Chain-of-Thought (CoT) Prompting-based Metaphor Mapping Identification Model (CPMMIM), which simulates the human cognitive process for identifying these mappings. Drawing inspiration from CoT reasoning and Bi-Level Optimization (BLO), we treat the task as a hierarchical identification problem, enabling more accurate and interpretable metaphor mapping. Our experimental results demonstrate the effectiveness of CPMMIM, highlighting its potential for advancing metaphor comprehension in NLP. Our dataset and code are both publicly available to encourage further advancements in this field.

隐喻理解多模态中文NLP可解释AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。