arXiv:2511.20679cs.AIcs.LG2025-11被引 1

用大模型自动优化知识层级,提升超球面嵌入质量

Minimizing Hyperbolic Embedding Distortion with LLM-Guided Hierarchy Restructuring

  • 用提示工程引导大模型重构知识层级结构
  • 16个数据集上嵌入质量全面提升,指标更优
  • 可解释重构过程,适合知识工程人员使用

超球几何在嵌入层次化数据结构方面表现优异,因此在推荐系统、计算机视觉等具有层次语义的任务中日益重要。超球嵌入质量与输入层级结构紧密相关,通常来自知识图谱或本体。已有研究发现,理想的超球嵌入需要高分支因子和单继承结构,且嵌入算法对不平衡和层级规模不敏感。本文探讨大语言模型(LLM)是否能自动重构层级以满足这些要求。提出一种基于提示的层级重构方法,由超球嵌入的理想特性指导。在16个多样化层级结构上的实验表明,经LLM重构后的层级在多个标准嵌入质量指标上均实现显著提升。此外,该方法还能提供可解释的重构理由,帮助知识工程师理解调整逻辑。

原文摘要 · Abstract (English)

Hyperbolic geometry is an effective geometry for embedding hierarchical data structures. Hyperbolic learning has therefore become increasingly prominent in machine learning applications where data is hierarchically organized or governed by hierarchical semantics, ranging from recommendation systems to computer vision. The quality of hyperbolic embeddings is tightly coupled to the structure of the input hierarchy, which is often derived from knowledge graphs or ontologies. Recent work has uncovered that for an optimal hyperbolic embedding, a high branching factor and single inheritance are key, while embedding algorithms are robust to imbalance and hierarchy size. To assist knowledge engineers in reorganizing hierarchical knowledge, this paper investigates whether Large Language Models (LLMs) have the ability to automatically restructure hierarchies to meet these criteria. We propose a prompt-based approach to transform existing hierarchies using LLMs, guided by known desiderata for hyperbolic embeddings. Experiments on 16 diverse hierarchies show that LLM-restructured hierarchies consistently yield higher-quality hyperbolic embeddings across several standard embedding quality metrics. Moreover, we show how LLM-guided hierarchy restructuring enables explainable reorganizations, providing justifications to knowledge engineers.

超球嵌入大模型应用知识图谱层级重构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。