分析基准测试可被操纵的程度,发现某些评分方式更难作弊。
How Hard is it to Rig a Benchmark? A Social Choice Analysis of Leaderboard Robustness
- 将数据集比作选民,模型比作候选人,用社会选择理论分析训练数据操控问题
- 平均胜率评分最难被操纵,其平均需22个任务才能提升排名(92%)
- 适合关注模型评估公平性的研究者和竞赛设计者参考
多任务基准已成为机器学习研究的核心,但其影响力也催生了基准游戏行为——为提升特定模型的排行榜名次而采取策略性操作。我们将数据集视为选民,模型视为候选人,将基准特定训练(即在训练中包含基准数据)视为选举操纵。对于任意序数基准,选择哪些数据集用于训练以使目标模型成为排名第一的问题,对应于计算社会选择中的‘转移贿赂’问题。基于此识别,我们证明基准特定训练问题在博达计分法和平均胜率下是NP难的。在此最坏情况分析基础上,我们引入实例级鲁棒性:模型开发者必须在训练中包含的最少数据集数量,才能在给定排行榜上排名第一,并推导出算术平均、中位数、平均胜率和成对多数制下的表达式。我们在HELM下的MMLU和Open LLM Leaderboard下的BIG-Bench Hard(BBH)上评估这些表达式。在两个评测套件中,平均胜率最难被操纵:在BBH(24个任务,4507个模型)上,其中位鲁棒性为22个任务(92%),远高于算术平均(13,54%)、中位数(12,50%)和成对多数制(12,50%)。
原文摘要 · Abstract (English)
Multi-task benchmarks have become a central pillar of machine learning research, yet their growing influence has incentivised benchmark gaming -- strategic actions taken to improve the leaderboard rank of a specific model. Treating datasets as voters and models as candidates, we consider benchmark-specific training -- the inclusion of benchmark data in training -- as a form of election manipulation. For any ordinal benchmark, the problem of choosing datasets to train on so that a target model becomes top-ranked corresponds to shift bribery, a class of manipulation problems from computational social choice. Leveraging this identification, we show that the benchmark-specific training problem is NP-hard under Borda count and mean win rate. Complementing this worst-case perspective, we introduce the instance-level robustness, the minimum number of datasets a model developer must include in training to top a given leaderboard, and derive expressions for it under arithmetic mean, median, mean win rate and pairwise majority. We evaluate these expressions on MMLU under HELM and on BIG-Bench Hard (BBH) under the Open LLM Leaderboard. Across both suites, mean win rate is hardest to manipulate: this gap is clear on BBH (24 tasks, 4507 models), where its median robustness is 22 tasks (92%), compared with 13 (54%) under arithmetic mean and 12 (50%) under median and pairwise majority.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。