用T5模型生成更准确的关键词,并自动过滤不相关词。
Enhancing Automatic Keyphrase Labelling with Text-to-Text Transfer Transformer (T5) Architecture: A Framework for Keyphrase Generation and Filtering
- 基于T5架构,输入标题摘要生成关键词
- 生成多组结果后按出现频率筛选,提升准确性
- 新过滤器可近乎完美去除错误关键词,适合文献管理
自动关键词标注旨在让模型提取能准确描述文档内容的词或短语。以往方法多采用抽取式技术,但无法生成文本中未出现的关键词。为此,本文提出基于Text-to-Text Transfer Transformer(T5)架构的关键词生成模型docT5keywords,以文档标题和摘要为输入,生成能充分描述内容的关键词。不仅采用经典直接输出策略,还引入多数投票机制:生成多个序列后,根据关键词在序列中的出现频率进行排序。同时,提出一种基于T5的新关键词过滤技术,训练模型判断给定关键词是否与文档相关。通过二分类评估和与其他自动关键词生成模型结合后的性能验证,证明该方法在所有数据集上均能近乎完美地消除假阳性。实验显示,生成模型在多个基准上表现显著优于现有方法,部分指标提升超过100%。
原文摘要 · Abstract (English)
Automatic keyphrase labelling stands for the ability of models to retrieve words or short phrases that adequately describe documents' content. Previous work has put much effort into exploring extractive techniques to address this task; however, these methods cannot produce keyphrases not found in the text. Given this limitation, keyphrase generation approaches have arisen lately. This paper presents a keyphrase generation model based on the Text-to-Text Transfer Transformer (T5) architecture. Having a document's title and abstract as input, we learn a T5 model to generate keyphrases which adequately define its content. We name this model docT5keywords. We not only perform the classic inference approach, where the output sequence is directly selected as the predicted values, but we also report results from a majority voting approach. In this approach, multiple sequences are generated, and the keyphrases are ranked based on their frequency of occurrence across these sequences. Along with this model, we present a novel keyphrase filtering technique based on the T5 architecture. We train a T5 model to learn whether a given keyphrase is relevant to a document. We devise two evaluation methodologies to prove our model's capability to filter inadequate keyphrases. First, we perform a binary evaluation where our model has to predict if a keyphrase is relevant for a given document. Second, we filter the predicted keyphrases by several AKG models and check if the evaluation scores are improved. Experimental results demonstrate that our keyphrase generation model significantly outperforms all the baselines, with gains exceeding 100\% in some cases. The proposed filtering technique also achieves near-perfect accuracy in eliminating false positives across all datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。