用词对高斯相似度提升孟加拉语摘要精度,效果比现有方法平均高43.2%。
A Novel Word Pair-based Gaussian Sentence Similarity Algorithm For Bengali Extractive Text Summarization
- 基于词对高斯相似度计算句间语义关系,避免平均向量的语义失真。
- 在四个数据集上平均ROUGE提升43.2%,最高达95.4%。
- 可推广至土耳其语、马拉地语等低资源语言,适合中文以外语种研究者。
抽取式文本摘要旨在不丢失关键信息的前提下选取原文中最具代表性的部分。现有孟加拉语抽取式摘要方法多依赖TF-IDF等统计技术或词平均相似度等简单度量,难以准确表达语义关系。本文提出一种新的词对基础高斯句子相似度(WGSS)算法,通过计算词嵌入向量间高斯相似度的几何平均值,实现词对级别的句间语义匹配,克服了传统词平均法的表示缺陷。摘要过程采用谱聚类将语义相近句子分组,并结合TF-IDF对每簇选出最优句子。该方法在四个不同数据集上验证,平均ROUGE得分提升43.2%(范围2.5%~95.4%)。同时在土耳其语、马拉地语和印地语等低资源语言上测试,表现与孟加拉语相当。此外,构建了一个包含250篇文章及对应摘要的高质量孟加拉语数据集。模型与数据已开源于https://github.com/FMOpee/WGSS。
原文摘要 · Abstract (English)
Extractive Text Summarization is the process of selecting the most representative parts of a larger text without losing any key information. Recent attempts at extractive text summarization in Bengali, either relied on statistical techniques like TF-IDF or used naive sentence similarity measures like the word averaging technique. All of these strategies suffer from expressing semantic relationships correctly. Here, we propose a novel Word pair-based Gaussian Sentence Similarity (WGSS) algorithm for calculating the semantic relation between two sentences. WGSS takes the geometric means of individual Gaussian similarity values of word embedding vectors to get the semantic relationship between sentences. It compares two sentences on a word-to-word basis which rectifies the sentence representation problem faced by the word averaging method. The summarization process extracts key sentences by grouping semantically similar sentences into clusters using the Spectral Clustering algorithm. After clustering, we use TF-IDF ranking to pick the best sentence from each cluster. The proposed method is validated using four different datasets, and it outperformed other recent models by 43.2% on average ROUGE scores (ranging from 2.5% to 95.4%). It is also experimented on other low-resource languages i.e. Turkish, Marathi, and Hindi language, where we find that the proposed method performs as similar as Bengali for these languages. In addition, a new high-quality Bengali dataset is curated which contains 250 articles and a pair of summaries for each of them. We believe this research is a crucial addition to Bengali Natural Language Processing (NLP) research and it can easily be extended into other low-resource languages. We made the implementation of the proposed model and data public on https://github.com/FMOpee/WGSS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。