arXiv:2509.00990stat.MLcs.CL2025-09被引 3

融合主题与图嵌入,提升法律文档无监督聚类效果

Hybrid Topic-Semantic Labeling and Graph Embeddings for Unsupervised Legal Document Clustering

  • 用Top2Vec和Node2Vec分别捕捉语义与结构特征
  • 结合嵌入向量聚类,较纯文本或纯图方法提升效果
  • 适合法律数据探索与后续监督学习准备

法律文档因领域专用语言和标注数据稀缺,分类难度大。本文提出一种混合方法,将无监督主题建模与图嵌入结合,利用Top2Vec学习语义文档表示并自动发现潜在主题,通过法律文档的二分图使用Node2Vec捕捉结构关系。将两种嵌入结合后采用KMeans聚类,形成语义连贯的文档分组。在真实法律文档数据集上的实验表明,Top2Vec+Node2Vec联合方法优于仅用文本或仅用图的嵌入。我们对超参数(如聚类数、嵌入维度)进行敏感性分析,结果表明该方法在性能上可媲美基线模型LDA和NMF。关键发现指出,该流程创新地结合了语义主题与图嵌入,但效果依赖于初始主题生成质量及嵌入模型对专业法律语言的表达能力。建议探索领域特定嵌入、更全面调参、动态确定聚类数,并引入人工验证以增强法律相关性与可信度。该流程适用于法律数据的探索性分析,也可作为监督学习的预处理步骤,但需进一步优化与领域适配才能用于实际法律应用。

原文摘要 · Abstract (English)

Legal documents pose unique challenges for text classification due to their domain-specific language and often limited labeled data. This paper proposes a hybrid approach for classifying legal texts by combining unsupervised topic and graph embeddings with a supervised model. We employ Top2Vec to learn semantic document embeddings and automatically discover latent topics, and Node2Vec to capture structural relationships via a bipartite graph of legal documents. The embeddings are combined and clustered using KMeans, yielding coherent groupings of documents. Our computations on a legal document dataset demonstrate that the combined Top2Vec+Node2Vec approach improves clustering quality over text-only or graph-only embeddings. We conduct a sensitivity analysis of hyperparameters, such as the number of clusters and the dimensionality of the embeddings, and demonstrate that our method achieves competitive performance against baseline Latent Dirichlet Allocation (LDA) and Non-Negative Matrix Factorization (NMF) models. Key findings indicate that while the pipeline presents an innovative approach to unsupervised legal document analysis by combining semantic topic modeling with graph embedding techniques, its efficacy is contingent upon the quality of initial topic generation and the representational power of the chosen embedding models for specialized legal language. Strategic recommendations include the exploration of domain-specific embeddings, more comprehensive hyperparameter tuning for Node2Vec, dynamic determination of cluster numbers, and robust human-in-the-loop validation processes to enhance legal relevance and trustworthiness. The pipeline demonstrates potential for exploratory legal data analysis and as a precursor to supervised learning tasks but requires further refinement and domain-specific adaptation for practical legal applications.

法律文本无监督学习图嵌入主题建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。