提出可自适应调整的课程学习方法,让模型高效跨越能力层级。
Level Up: Defining and Exploiting Transitional Problems for Curriculum Learning
- 以模型能力为基准动态定义问题难易度,识别出过渡性难题。
- 按过渡性难题由易到难排序训练,提升效率优于传统策略。
- 适合需要分阶段训练的模型优化场景,如大模型预训练。
课程学习通过有序安排训练样本促进机器学习,但现有方法多依赖间接难度评分,缺乏对学习者的针对性。本文提出一种基于模型能力进阶的直接难度评估方法,识别出随模型能力提升而始终更易的问题——过渡性问题。在多个任务中构建不同能力层级的模型系列,发现从较易的过渡性问题开始逐步升级训练,能最高效地推动模型进入下一能力层级。该方法生成可解释、个性化且具原则性的课程,实现自然的能力进阶路径,显著优于其他训练策略。
原文摘要 · Abstract (English)
Curriculum learning--ordering training examples in a sequence to aid machine learning--takes inspiration from human learning, but has not gained widespread acceptance. Static strategies for scoring item difficulty rely on indirect proxy scores of varying quality and produce curricula that are not specific to the learner at hand. Dynamic approaches base difficulty estimates on gradient information, requiring considerable extra computation during training. We introduce a novel method for measuring the difficulty of individual problem instances that is calibrated to a series of models of increasing competence, and identify \emph{transitional problems} that are consistently easier as model ability increases. Applying this method to diverse model series constructed from sets of models that are readily available on many tasks, we find that training on a curriculum that \emph{levels up} from easier to harder transitional problems most efficiently improves a model to the next tier of competence. These problems induce a natural progression from easier to harder items, which outperforms other training strategies. By measuring difficulty directly relative to model competence, our method yields interpretable problems, learner-specific curricula, and a principled basis for step-by-step improvement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。