让文本丰富的网络学会层次化知识,提升模型可解释性。
Learning Hierarchical Knowledge in Text-Rich Networks with Taxonomy-Informed Representation Learning
- 通过对比学习构建聚类友好的嵌入空间,再用大模型优化聚类生成层级分类体系
- 在多个跨领域数据集上显著优于现有方法,层次结构对性能提升关键
- 适合需要结构化理解的文本网络任务,如知识图谱、语义检索
层次化知识结构广泛存在于现实世界中,从粗粒度到细粒度组织信息。尽管在分类系统、生物医学本体和检索增强生成中已有应用,其潜力在包含丰富文本内容且边表示语义关系的文本丰富网络(TRNs)中仍未被充分挖掘。现有方法多聚焦于扁平语义建模,忽视了文档中的固有层次语义。为此,我们提出TIER(Taxonomy-Informed Representation Learning on Text-Rich Networks),先构建隐式层次分类体系,再将其融入节点表示。TIER采用相似性引导的对比学习建立聚类友好的嵌入空间,继而进行分层K-Means,并利用大语言模型进行聚类精炼以实现语义一致的分类体系构建。基于所得分类体系,引入基于科芬系数的正则化损失,使学习到的嵌入与层次结构对齐。通过同时尊重细粒度与粗粒度语义,TIER实现了更可解释、结构化的真实TRN建模。我们在多个跨领域数据集上验证了该方法显著优于现有基准,凸显了层次知识学习在TRNs中的重要性。
原文摘要 · Abstract (English)
Hierarchical knowledge structures are ubiquitous across real-world domains and play a vital role in organizing information from coarse to fine semantic levels. While such structures have been widely used in taxonomy systems, biomedical ontologies, and retrieval-augmented generation, their potential remains underexplored in the context of Text-Rich Networks (TRNs), where each node contains rich textual content and edges encode semantic relationships. Existing methods for learning on TRNs often focus on flat semantic modeling, overlooking the inherent hierarchical semantics embedded in textual documents. To this end, we propose TIER (Hierarchical \textbf{T}axonomy-\textbf{I}nformed R\textbf{E}presentation Learning on Text-\textbf{R}ich Networks), which first constructs an implicit hierarchical taxonomy and then integrates it into the learned node representations. Specifically, TIER employs similarity-guided contrastive learning to build a clustering-friendly embedding space, upon which it performs hierarchical K-Means followed by LLM-powered clustering refinement to enable semantically coherent taxonomy construction. Leveraging the resulting taxonomy, TIER introduces a cophenetic correlation coefficient-based regularization loss to align the learned embeddings with the hierarchical structure. By learning representations that respect both fine-grained and coarse-grained semantics, TIER enables more interpretable and structured modeling of real-world TRNs. We demonstrate that our approach significantly outperforms existing methods on multiple datasets across diverse domains, highlighting the importance of hierarchical knowledge learning for TRNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。