为大模型设计可机器读取的溯源记录,提升透明度与管理效率。
Mitigating Downstream Model Risks via Model Provenance
- 提出统一模型记录格式,自动追踪上下游模型关系。
- 构建可托管的语义化版本仓库,支持多格式自动生成。
- 适合模型开发者、平台方及监管机构使用,推动负责任创新。
研究与产业正加速推进基于基础模型的系统创新与应用,但模型管理工具未能同步发展。理解模型的来源与演化路径对研究人员、产业界、监管机构及公众信任至关重要。尽管模型卡片和系统卡片旨在提升透明度,但在追踪模型谱系、实现机器可读性、提供可靠集中管理以及激励一致创建方面仍存在短板。这一挑战类似于软件供应链安全问题,但人工智能/机器学习领域尚处于早期成熟阶段。解决这些差距需要行业标准工具,适用于基础模型发布者、开源创新者及主要分发平台。本文提出一种机器可读的模型规范格式,简化模型记录创建,显著降低人为错误,尤其在新模型继承基础模型大部分设计时。解决方案明确追踪上游与下游模型间的关联,增强全生命周期的透明度与可追溯性。为促进采用,我们引入统一模型记录(UMR)仓库,一个语义化版本系统,可自动将模型记录发布为多种格式(PDF、HTML、LaTeX),并提供托管网页界面(https://modelrecord.com/)。该概念验证旨在建立基础模型管理的新标准,弥合创新与负责任管理之间的鸿沟。
原文摘要 · Abstract (English)
Research and industry are rapidly advancing the innovation and adoption of foundation model-based systems, yet the tools for managing these models have not kept pace. Understanding the provenance and lineage of models is critical for researchers, industry, regulators, and public trust. While model cards and system cards were designed to provide transparency, they fall short in key areas: tracing model genealogy, enabling machine readability, offering reliable centralized management systems, and fostering consistent creation incentives. This challenge mirrors issues in software supply chain security, but AI/ML remains at an earlier stage of maturity. Addressing these gaps requires industry-standard tooling that can be adopted by foundation model publishers, open-source model innovators, and major distribution platforms. We propose a machine-readable model specification format to simplify the creation of model records, thereby reducing error-prone human effort, notably when a new model inherits most of its design from a foundation model. Our solution explicitly traces relationships between upstream and downstream models, enhancing transparency and traceability across the model lifecycle. To facilitate the adoption, we introduce the unified model record (UMR) repository , a semantically versioned system that automates the publication of model records to multiple formats (PDF, HTML, LaTeX) and provides a hosted web interface (https://modelrecord.com/). This proof of concept aims to set a new standard for managing foundation models, bridging the gap between innovation and responsible model management.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。