用参考信息提升无监督关键词生成的准确性和速度。
ERU-KG: Efficient Reference-aligned Unsupervised Keyphrase Generation
- 基于参考信息与词级建模,更精准估计关键词重要性。
- 在顶10预测上达监督模型89%性能,且推理速度最快。
- 支持生成与提取模式切换,适合不同应用场景。
无监督关键词生成近年受关注,但现有方法依赖启发式重要性评分,易导致信息量估计不准,且效率低。为此,我们提出ERU-KG,包含信息量模块和短语生成模块。前者通过参考信息(如查询、引文上下文、标题)在词级建模信息量,从而捕捉文档核心概念在不同语境中的表现,并通过聚合词级信息量高效估算短语信息量,无需显式建模候选短语。实验表明,ERU-KG在关键词生成基准上优于无监督基线,在顶10预测上平均达到监督模型89%的性能。此外,将其生成的关键词用于文本检索任务时,作为查询和文档扩展均有效。推理速度测试显示,其在同规模模型中最快。最后,通过调整超参数,模型可灵活切换为生成或提取模式,适配多样应用需求。
原文摘要 · Abstract (English)
Unsupervised keyphrase prediction has gained growing interest in recent years. However, existing methods typically rely on heuristically defined importance scores, which may lead to inaccurate informativeness estimation. In addition, they lack consideration for time efficiency. To solve these problems, we propose ERU-KG, an unsupervised keyphrase generation (UKG) model that consists of an informativeness and a phraseness module. The former estimates the relevance of keyphrase candidates, while the latter generate those candidates. The informativeness module innovates by learning to model informativeness through references (e.g., queries, citation contexts, and titles) and at the term-level, thereby 1) capturing how the key concepts of documents are perceived in different contexts and 2) estimating informativeness of phrases more efficiently by aggregating term informativeness, removing the need for explicit modeling of the candidates. ERU-KG demonstrates its effectiveness on keyphrase generation benchmarks by outperforming unsupervised baselines and achieving on average 89\% of the performance of a supervised model for top 10 predictions. Additionally, to highlight its practical utility, we evaluate the model on text retrieval tasks and show that keyphrases generated by ERU-KG are effective when employed as query and document expansions. Furthermore, inference speed tests reveal that ERU-KG is the fastest among baselines of similar model sizes. Finally, our proposed model can switch between keyphrase generation and extraction by adjusting hyperparameters, catering to diverse application requirements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。