用检索增强生成提升框架检测,无需预设目标片段。
Enhancing Frame Detection with Retrieval Augmented Generation
- 通过生成框架嵌入并检索候选框架,再识别最优框架。
- 在FrameNet 1.5和1.7上达到当前最佳性能,零样本与少样本均有效。
- 适合需要泛化处理词汇变化的自然语言问答转查询任务。
自然语言处理的进步显著提升了从非结构化文本中提取结构化语义表示的能力,尤其是在框架语义角色标注(FSRL)方面。尽管如此,检索增强生成(RAG)模型在框架检测中的潜力仍待探索。本文提出首个基于RAG的框架检测方法RCIF(Retrieve Candidates and Identify Frames),也是首个无需显式目标跨度的方法。该方法包含三个阶段:(1) 从多种表示中生成框架嵌入;(2) 根据输入文本检索候选框架;(3) 识别最合适的框架。我们在多种配置下进行了广泛实验,包括零样本、少样本和微调设置。结果表明,检索组件通过缩小搜索空间显著降低任务复杂度,使框架识别器能够精炼并补全候选集。该方法在FrameNet 1.5和1.7上取得当前最佳性能,证明了其在仅提供原始文本场景下的鲁棒性。此外,我们利用该方法获得的结构化表示作为代理,提升了将自然语言问题转化为SPARQL查询任务中的泛化能力。
原文摘要 · Abstract (English)
Recent advancements in Natural Language Processing have significantly improved the extraction of structured semantic representations from unstructured text, especially through Frame Semantic Role Labeling (FSRL). Despite this progress, the potential of Retrieval-Augmented Generation (RAG) models for frame detection remains under-explored. In this paper, we present the first RAG-based approach for frame detection called RCIF (Retrieve Candidates and Identify Frames). RCIF is also the first approach to operate without the need for explicit target span and comprises three main stages: (1) generation of frame embeddings from various representations ; (2) retrieval of candidate frames given an input text; and (3) identification of the most suitable frames. We conducted extensive experiments across multiple configurations, including zero-shot, few-shot, and fine-tuning settings. Our results show that our retrieval component significantly reduces the complexity of the task by narrowing the search space thus allowing the frame identifier to refine and complete the set of candidates. Our approach achieves state-of-the-art performance on FrameNet 1.5 and 1.7, demonstrating its robustness in scenarios where only raw text is provided. Furthermore, we leverage the structured representation obtained through this method as a proxy to enhance generalization across lexical variations in the task of translating natural language questions into SPARQL queries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。