揭示大模型背后的隐藏依赖关系,让开发透明可追溯。
Which Models Are Our Models Built On? Auditing Invisible Dependencies in Modern LLMs

- 用智能系统递归追踪模型依赖,基于真实来源证据构建图谱。
- 发现1060个经验证的依赖关系,暴露多跳许可证义务等风险。
- 适合关注模型可信度、合规性与生态透明性的研究者和开发者。
现代大模型训练日益依赖其他模型生成数据、筛选语料、评估输出并指导决策,形成复杂的递归依赖结构。这些依赖分散在不同公开发布物中,文档不一致且版本交错,难以人工追踪。我们提出ModSleuth,一种基于代理的系统,能从公开资源中递归重构模型依赖图,并以源码证据为依据。核心挑战已从信息提取转向依赖定义与实体辨识。我们通过区分直接/间接依赖、用操作中心关系表示多样化流程角色、跨名称/版本/仓库统一实体标识来解决。应用于四个公开大模型项目,共恢复1,060个源验证依赖,构建大规模依赖图谱,揭示多跳许可证义务、训练-评估耦合、发布版与训练版差异、文档不一致等隐性问题。我们开源ModSleuth与依赖图谱,助力透明分析现代大模型复杂生态。
原文摘要 · Abstract (English)
Modern LLM training pipelines increasingly rely on other models to generate data, filter corpora, judge outputs, and guide development decisions. These dependencies are recursive: a model may depend on an upstream artifact whose own dependencies are documented only in separate releases and artifacts. As a result, the full dependency structure is fragmented across heterogeneous public artifacts, with complexity and recursive depth far outpacing humans' ability to trace. We introduce ModSleuth, an agentic system that recursively reconstructs LLM dependency graphs from public artifacts with source-grounded evidence. We find that the primary challenge is no longer information extraction, but defining what constitutes a dependency and reconciling artifact references across inconsistent documentation. We address these challenges through a formalization that distinguishes direct and indirect dependencies, represents heterogeneous pipeline roles through operation-centered relationships, and resolves artifact identities across names, versions, and repositories. Applying ModSleuth to four public-artifact-rich LLM releases, we recover 1,060 source-verified dependencies and construct large-scale dependency graphs of modern LLM development. These graphs reveal multi-hop license obligations, train-evaluation coupling, discrepancies between released and training-time artifacts, and documentation inconsistencies that would otherwise be difficult to uncover. We release ModSleuth and the resulting dependency graphs to support transparent analysis of the increasingly complex ecosystems underlying modern LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。