2025年模型透明度指数显示行业透明度下滑,平均分降至40。
The 2025 Foundation Model Transparency Index
- 首次评估阿里、DeepSeek、xAI等公司,引入数据采集与使用监控新指标
- 平均分从2024年58分降至2025年40分,训练数据与算力信息最不透明
- IBM以95分成最大亮点,政策推动或需更激进干预填补信息缺口
基础模型开发者是全球最重要的企业之一。随着这些公司影响力日益增强,其透明度实践如何演变?2025年基础模型透明度指数(FMTI)是年度系列的第三版,旨在刻画并量化基础模型开发者的透明度水平。2025年版本新增了关于数据获取、使用数据和监测的指标,并首次评估了阿里巴巴、DeepSeek和xAI等公司。2024年FMTI报告指出透明度正在改善,但2025年发现这一进展已逆转:平均得分从2024年的58分下降至2025年的40分。公司在其旗舰模型的训练数据、训练算力,以及部署后的使用情况与影响方面最为不透明。尽管整体趋势消极,IBM表现突出,得分为95,远高于最低分14的xAI和Midjourney。我们对前沿模型论坛(Frontier Model Forum)五家成员的评分位于中游:我们推测,这些公司避免低分带来的声誉损害,但缺乏成为透明度领导者动力。随着全球政策制定者不断要求特定类型的透明度,本研究揭示了当前基础模型开发者的透明度状况,以及新出台政策可能带来的变化,并指明了在关键信息缺失处需要更激进政策干预的领域。
原文摘要 · Abstract (English)
Foundation model developers are among the world's most important companies. As these companies become increasingly consequential, how do their transparency practices evolve? The 2025 Foundation Model Transparency Index is the third edition of an annual effort to characterize and quantify the transparency of foundation model developers. The 2025 FMTI introduces new indicators related to data acquisition, usage data, and monitoring and evaluates companies like Alibaba, DeepSeek, and xAI for the first time. The 2024 FMTI reported that transparency was improving, but the 2025 FMTI finds this progress has deteriorated: the average score out of 100 fell from 58 in 2024 to 40 in 2025. Companies are most opaque about their training data and training compute as well as the post-deployment usage and impact of their flagship models. In spite of this general trend, IBM stands out as a positive outlier, scoring 95, in contrast to the lowest scorers, xAI and Midjourney, at just 14. The five members of the Frontier Model Forum we score end up in the middle of the Index: we posit that these companies avoid reputational harms from low scores but lack incentives to be transparency leaders. As policymakers around the world increasingly mandate certain types of transparency, this work reveals the current state of transparency for foundation model developers, how it may change given newly enacted policy, and where more aggressive policy interventions are necessary to address critical information deficits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。