用可靠例句增强大模型,让关系抽取更准更省力。
Combining Distantly Supervised Models with In Context Learning for Monolingual and Cross-Lingual Relation Extraction
- 先选候选关系,再动态找靠谱例句给大模型提示。
- 英语上最高提升20点F1,印地语系低资源语言平均+17点。
- 适合做单语和低资源多语种关系抽取的场景。
远程监督关系抽取(DSRE)在自然语言处理中长期面临挑战:模型需从噪声严重的分组标注中学习,却要做出句子级预测。现有最先进(SoTA)的DSRE模型依赖任务特训,但与大语言模型(LLM)的上下文学习(ICL)结合仍不充分。主要难点在于,由于标注噪声,LLM可能无法正确学习关系语义。为此,我们提出HYDRE——一种混合远程监督关系抽取框架。该框架首先用训练好的DSRE模型为测试句生成前k个候选关系,再通过一种新型动态例句检索策略,从训练数据中提取可靠的句子级例句,将其作为LLM提示中的示例,以输出最终关系。我们进一步将HYDRE扩展至跨语言场景,用于低资源语言的关系抽取。利用现有的英文DSRE训练数据,在英文及新构建的涵盖四种多样化低资源印地语系语言(奥里亚语、桑塔利语、曼尼普里语、图鲁语)的基准上进行评估。HYDRE在英文上实现最高20点的F1提升,在印地语系语言上平均提升17点F1,显著优于先前最先进模型。详细消融实验验证了其相对于其他提示策略的有效性。
原文摘要 · Abstract (English)
Distantly Supervised Relation Extraction (DSRE) remains a long-standing challenge in NLP, where models must learn from noisy bag-level annotations while making sentence-level predictions. While existing state-of-the-art (SoTA) DSRE models rely on task-specific training, their integration with in-context learning (ICL) using large language models (LLMs) remains underexplored. A key challenge is that the LLM may not learn relation semantics correctly, due to noisy annotation. In response, we propose HYDRE -- HYbrid Distantly Supervised Relation Extraction framework. It first uses a trained DSRE model to identify the top-k candidate relations for a given test sentence, then uses a novel dynamic exemplar retrieval strategy that extracts reliable, sentence-level exemplars from training data, which are then provided in LLM prompt for outputting the final relation(s). We further extend HYDRE to cross-lingual settings for RE in low-resource languages. Using available English DSRE training data, we evaluate all methods on English as well as a newly curated benchmark covering four diverse low-resource Indic languages -- Oriya, Santali, Manipuri, and Tulu. HYDRE achieves up to 20 F1 point gains in English and, on average, 17 F1 points on Indic languages over prior SoTA DSRE models. Detailed ablations exhibit HYDRE's efficacy compared to other prompting strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。