提出首个针对低资源孟加拉语的图融合主题模型GHTM,提升主题质量与可复现性。
GHTM: A Graph-based Hybrid Topic Modeling Approach with a Benchmark Dataset for the Low-Resource Bengali Language
- 结合词频权重、GloVe嵌入与图卷积网络构建文本表示
- 在3个孟加拉语数据集上实现0.27-0.28的高主题一致性(NPMI)
- 引入新基准数据集NCTBText,覆盖8个学科共8650篇教材文本
主题建模是自然语言处理中通过聚类共现关键词发现文本潜在主题的技术。尽管英语领域研究广泛,孟加拉语因缺乏资源和标准化评估框架而研究不足。现有研究缺乏统一评估体系、多样数据集及可复现实现,仅出现过三个专用于孟加拉语的模型架构。本文全面评估传统与现代方法,在三个孟加拉语数据集上提出GHTM(基于图的混合主题模型),融合TF-IDF加权的GloVe嵌入、图卷积网络(GCN)与非负矩阵分解(NMF)。GHTM使用混合加权嵌入表示文档,构建文档相似性图并利用GCN进行邻域聚合以优化表示,最后通过NMF提取可解释主题。实验表明,GHTM在不同规模数据集上均实现更高主题一致性(NPMI: 0.27–0.28)与多样性,同时保持高效计算性能,并在跨语言泛化上优于现有图模型,在英文20Newsgroups数据集表现更优。此外,本文发布新基准数据集NCTBText,包含来自八个学科的8,650篇教材文本,突破传统新闻语料局限,为未来研究提供多样化资源。
原文摘要 · Abstract (English)
Topic modeling is a Natural Language Processing (NLP) technique used to discover latent themes and abstract topics from text corpora by grouping co-occurring keywords. Although widely researched in English, topic modeling remains understudied in Bengali due to a lack of adequate resources and initiatives. Existing Bengali topic modeling research lacks standardized evaluation frameworks with comprehensive baselines and diverse datasets, exploration of modern methodological approaches, and reproducible implementations, with only three Bengali-specific architectures proposed to date. To address these gaps, this study presents a comprehensive evaluation of traditional and contemporary topic modeling approaches across three Bengali datasets and introduces GHTM (Graph-based Hybrid Topic Model), a novel architecture that strategically integrates TF-IDF-weighted GloVe embeddings, Graph Convolutional Networks (GCN), and Non-negative Matrix Factorization (NMF). GHTM represents text documents using hybrid TF-IDF-weighted GloVe embeddings. It builds a document-similarity graph and leverages GCN to refine the representations through neighborhood aggregation. Then, it finally decomposes the refined representations using NMF to extract interpretable topics. Experimental results demonstrate that GHTM achieves superior topic coherence (NPMI: 0.27-0.28) and diversity compared to existing methods while maintaining computational efficiency across datasets of varying scales. The model also demonstrates strong cross-lingual generalization, outperforming established graph-based models on the English 20Newsgroups benchmark. Additionally, we introduce NCTBText, a diverse Bengali textbook-based dataset comprising 8,650 text documents, curated from eight subject areas, providing much-needed topical diversity beyond newspaper-centric Bengali corpora and serving as a benchmark for future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。