arXiv:2601.08841cs.CLcs.AI2026-01被引 2

用知识三元组提升科学文献分类,但纯文本效果更稳。

Triples and Knowledge-Infused Embeddings for Clustering and Classification of Scientific Documents

  • 用三元组+文本混合表示,结合多种嵌入模型
  • 纯文本达0.923准确率,三元组未持续提升性能
  • 适合想验证知识增强效果的研究者参考

科学文献体量与复杂度激增,亟需高效组织与理解方法。本文研究结构化知识(即主语-谓语-宾语三元组)对科学论文聚类与分类的影响。提出模块化流程,融合无监督聚类与有监督分类,测试四种文档表示:摘要、三元组、摘要+三元组、混合表示。基于过滤后的arXiv语料库,评估四种Transformer嵌入(MiniLM、MPNet、SciBERT、SPECTER)搭配KMeans、GMM、HDBSCAN,并训练主题预测分类器。在五次随机种子(40-44)基准下,仅使用摘要的输入表现最优且最稳定,平均准确率达0.923,宏平均F1为0.923。仅使用三元组或融合知识的变体未持续超越该基线。聚类方面,KMeans/GMM在外部有效性指标上优于HDBSCAN,后者对噪声更敏感。结果表明,直接添加抽取三元组未必带来收益,甚至可能因表示选择导致性能下降。研究揭示了知识注入在科学文档建模中的作用:三元组具信息量但非普适优势,其效果高度依赖配置。提供可复现基准,为知识增强表示何时有效提供实践指导。

原文摘要 · Abstract (English)

The increasing volume and complexity of scientific literature demand robust methods for organizing and understanding research documents. In this study, we investigate whether structured knowledge, specifically, subject-predicate-object triples-improves clustering and classification of scientific papers. We present a modular pipeline that combines unsupervised clustering and supervised classification across four document representations: abstract, triples, abstract+triples, and hybrid. Using a filtered arXiv corpus, we evaluate four transformer embeddings (MiniLM, MPNet, SciBERT, SPECTER) with KMeans, GMM, and HDBSCAN, and then train downstream classifiers for subject prediction. Across a five-seed benchmark (seeds 40-44), abstract-only inputs provide the strongest and most stable classification performance, reaching 0.923 accuracy and 0.923 macro-F1 (mean). Triple-only and knowledge-infused variants do not consistently outperform this baseline. In clustering, KMeans/GMM generally outperform HDBSCAN on external validity metrics, while HDBSCAN exhibits higher noise sensitivity. We observe that adding extracted triples naively does not guarantee gains and can reduce performance depending on representation choice. These results refine the role of knowledge infusion in scientific document modeling: structured triples are informative but not universally beneficial, and their impact is strongly configuration-dependent. Our findings provide a reproducible benchmark and practical guidance for when knowledge-augmented representations help, and when strong text-only baselines remain preferable.

文献分类知识图谱文本表示嵌入模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。