无监督融合文本与图结构,自动发现高质量社区并生成可部署分类器
Dual Refinement Cycle Learning: Unsupervised Text Classification of Mamba and Community Detection on Text Attributed Graph
- 通过双向迭代优化图结构与文本语义模块,实现无监督联合学习
- 在多个数据集上提升社区结构与语义质量,且分类准确率接近有监督模型
- 适合标签稀缺场景,如社交网络分析、内容推荐等实际应用
预训练语言模型虽具备强大文本理解能力,但在真实文本属性网络中部署困难,因其高度依赖标注数据。同时,传统社区检测方法常忽略文本语义,限制了其在内容组织、推荐和风险监控等下游任务中的应用。为此,我们提出完全无监督的双精炼循环学习框架(DRCL),适用于无标签或类别定义的现实场景。DRCL通过冷启动初始化,结合基于GCN的社区检测模块(GCN-CDM)与文本语义建模模块(TSMM)之间的双向精炼循环,迭代交换伪标签,使语义线索增强结构聚类,结构模式引导文本表征学习,无需人工监督。在多个文本属性图数据集上,DRCL持续提升发现社区的结构与语义质量。此外,仅使用DRCL生成的社区信号训练的Mamba分类器,达到与监督模型相当的准确率,展现出在大规模系统中标签稀缺场景下的部署潜力。代码已开源。
原文摘要 · Abstract (English)
Pretrained language models offer strong text understanding capabilities but remain difficult to deploy in real-world text-attributed networks due to their heavy dependence on labeled data. Meanwhile, community detection methods typically ignore textual semantics, limiting their usefulness in downstream applications such as content organization, recommendation, and risk monitoring. To overcome these limitations, we present Dual Refinement Cycle Learning (DRCL), a fully unsupervised framework designed for practical scenarios where no labels or category definitions are available. DRCL integrates structural and semantic information through a warm-start initialization and a bidirectional refinement cycle between a GCN-based Community Detection Module (GCN-CDM) and a Text Semantic Modeling Module (TSMM). The two modules iteratively exchange pseudo-labels, allowing semantic cues to enhance structural clustering and structural patterns to guide text representation learning without manual supervision. Across several text-attributed graph datasets, DRCL consistently improves the structural and semantic quality of discovered communities. Moreover, a Mamba-based classifier trained solely from DRCL's community signals achieves accuracy comparable to supervised models, demonstrating its potential for deployment in large-scale systems where labeled data are scarce or costly. The code is available at https://github.com/wuanghoong/DRCL.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。