arXiv:2509.23773cs.LGcs.AI2025-09

发现大模型知识存在邻近相似性,可高效定位薄弱环节。

Knowledge Homophily in Large Language Models

  • 用图结构分析模型对实体的知识掌握程度。
  • 相近实体的知识水平高度相似,可预测未知知识。
  • 基于邻居信息优先检查薄弱三元组,提升标注效率。

大型语言模型(LLMs)在问答和事实核查等知识密集型应用中日益受到关注,但其知识的结构组织仍不明确。受认知神经科学中语义聚类与启动效应启发——知道一个事实会增加回忆相关事实的概率——我们研究了LLM中类似的知识同质性模式。通过在三元组和实体层面进行知识检测,将模型知识映射为图结构,并分析实体与其邻接实体之间的知识能力关系,发现距离图中更近的实体,其知识掌握程度趋于相似。基于此同质性原则,我们提出一种图神经网络(GNN)回归模型,利用邻域知识能力分数来预测三元组的实体级知识能力得分。该预测结果可用于优先检查知识较弱的三元组,在相同标注预算下最大化知识覆盖范围。这不仅提升了微调时注入知识的主动标注效率,也增强了推理密集型问答中的多跳路径检索能力。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have been increasingly studied as neural knowledge bases for supporting knowledge-intensive applications such as question answering and fact checking. However, the structural organization of their knowledge remains unexplored. Inspired by cognitive neuroscience findings, such as semantic clustering and priming, where knowing one fact increases the likelihood of recalling related facts, we investigate an analogous knowledge homophily pattern in LLMs. To this end, we map LLM knowledge into a graph representation through knowledge checking at both the triplet and entity levels. After that, we analyze the knowledgeability relationship between an entity and its neighbors, discovering that LLMs tend to possess a similar level of knowledge about entities positioned closer in the graph. Motivated by this homophily principle, we propose a Graph Neural Network (GNN) regression model to estimate entity-level knowledgeability scores for triplets by leveraging their neighborhood scores. The predicted knowledgeability enables us to prioritize checking less well-known triplets, thereby maximizing knowledge coverage under the same labeling budget. This not only improves the efficiency of active labeling for fine-tuning to inject knowledge into LLMs but also enhances multi-hop path retrieval in reasoning-intensive question answering.

知识图谱大模型图神经网络主动学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。