arXiv:2509.02399cs.LGcs.CL2025-09

检验谱梯度复杂度度量在知识图谱链接预测中的有效性

Evaluating Cumulative Spectral Gradient as a Complexity Measure

  • 通过蒙特卡洛采样与近邻数调节谱梯度计算
  • 发现该度量对近邻数敏感且与MRR相关性弱
  • 质疑其作为通用复杂度指标的可靠性

准确估计数据集复杂度对评估和比较知识图谱(KG)链接预测模型至关重要。累积谱梯度(CSG)是一种基于谱聚类框架中类别间概率发散的复杂度度量,声称具备(1)随类别数量自然扩展的特性,(2)与下游分类性能强相关。本文在标准知识图谱链接预测基准(包括多类别尾部预测任务)上,严格评估了CSG行为,重点关注其计算中的两个关键参数:每类的蒙特卡洛采样点数M和嵌入空间中的最近邻数K。结果表明,(1)CSG对K的选择高度敏感,不具备天然的类别数量可扩展性;(2)CSG值与均倒数排名(MRR)等主流性能指标呈现弱或无相关性。在FB15k-237、WN18RR等多个标准数据集上的实验显示,CSG宣称的稳定性与泛化预测能力在链接预测场景下失效。研究强调需要更鲁棒、不依赖分类器的复杂度度量用于KG链接预测评估。

原文摘要 · Abstract (English)

Accurate estimation of dataset complexity is crucial for evaluating and comparing link prediction models for knowledge graphs (KGs). The Cumulative Spectral Gradient (CSG) metric derived from probabilistic divergence between classes within a spectral clustering framework was proposed as a dataset complexity measure that (1) naturally scales with the number of classes and (2) correlates strongly with downstream classification performance. In this work, we rigorously assess CSG behavior on standard knowledge graph link prediction benchmarks a multi class tail prediction task, using two key parameters governing its computation, M, the number of Monte Carlo sampled points per class, and K, the number of nearest neighbors in the embedding space. Contrary to the original claims, we find that (1) CSG is highly sensitive to the choice of K and therefore does not inherently scale with the number of target classes, and (2) CSG values exhibit weak or no correlation with established performance metrics such as mean reciprocal rank (MRR). Through experiments on FB15k 237, WN18RR, and other standard datasets, we demonstrate that CSG purported stability and generalization predictive power break down in link prediction settings. Our results highlight the need for more robust, classifier agnostic complexity measures in KG link prediction evaluation.

知识图谱复杂度度量链接预测谱分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。