用几何空间解析大模型对音乐流派的理解,发现其内部知识可被准确提取。
Vector Ontologies as an LLM world view extraction method
- 构建8维音乐流派向量本体,将大模型的隐含知识转为可分析的几何结构。
- 47种不同提问方式下,音乐流派位置保持高度一致,与真实音频特征高度吻合。
- 提示词变化直接影响模型认知位置,适合研究大模型内部表示的透明化方法。
大型语言模型(LLMs)拥有复杂的世界内部表征,但这些潜在结构难以解释或复用于原始任务之外。基于先前工作(Rothenfusser, 2025),本文首次对向量本体方法进行实证验证。向量本体定义了一个由语义上意义明确的维度构成的领域特定向量空间,使概念与关系的几何分析成为可能。我们基于Spotify音频特征构建了8维音乐流派向量本体,并测试GPT-4o-mini能否将音乐世界的内部模型一致且准确地投影到该空间。通过多种自然语言提示提取流派表示,分析其在语言变体下的稳定性及与真实数据的一致性。结果表明:(1) 47种查询形式下,流派投影具有高空间一致性;(2) 模型推断的流派位置与真实音频特征分布显著对齐;(3) 提示词表述直接影响模型推断的向量本体空间位移。这证明了LLMs内化了结构化、可复用的知识,而向量本体为透明、可验证地提取和分析此类知识提供了有效路径。
原文摘要 · Abstract (English)
Large Language Models (LLMs) possess intricate internal representations of the world, yet these latent structures are notoriously difficult to interpret or repurpose beyond the original prediction task. Building on our earlier work (Rothenfusser, 2025), which introduced the concept of vector ontologies as a framework for translating high-dimensional neural representations into interpretable geometric structures, this paper provides the first empirical validation of that approach. A vector ontology defines a domain-specific vector space spanned by ontologically meaningful dimensions, allowing geometric analysis of concepts and relationships within a domain. We construct an 8-dimensional vector ontology of musical genres based on Spotify audio features and test whether an LLM's internal world model of music can be consistently and accurately projected into this space. Using GPT-4o-mini, we extract genre representations through multiple natural language prompts and analyze the consistency of these projections across linguistic variations and their alignment with ground-truth data. Our results show (1) high spatial consistency of genre projections across 47 query formulations, (2) strong alignment between LLM-inferred genre locations and real-world audio feature distributions, and (3) evidence of a direct relationship between prompt phrasing and spatial shifts in the LLM's inferred vector ontology. These findings demonstrate that LLMs internalize structured, repurposable knowledge and that vector ontologies offer a promising method for extracting and analyzing this knowledge in a transparent and verifiable way.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。