arXiv:2609.09099cs.LG2026-09

用数学路径分析教学顺序,发现最优策略因任务而异。

Curriculum Learning as Transport: Understanding Curricula with Wasserstein Geodesics

论文配图:Curriculum Learning as Transport: Understanding Curricula with Wasserstein Geodesics
图 1 · 摘自论文原文
  • 将教学顺序建模为分布迁移路径,解耦难度定义与训练节奏
  • 实验证明先易后难优于均匀采样,且效果取决于预算分配
  • 框架可扩展至自适应节奏与多维难度空间,适合研究者优化训练策略

课程学习受多个相互关联的设计选择影响——难度定义、样本排序、各层级暴露量及跨层级转移速度,难以分离其实际作用。本文提出基于沃尔德斯坦测地线的课程路径框架,将课程表示为离散难度层级上训练分布的轨迹,从而解耦这些因素。在包含12个任务和33个难度轴的校准合成基准上,该框架用于分离排序、匹配暴露、终点平滑度与节奏在固定训练预算下的影响。结果表明,课程效应具有强情境依赖性:不存在对所有任务、难度轴和预算均占优的单一策略;课程主要改变固定预算下资源的最优分配位置。在该框架下,先易后难排序相比暴露量匹配的静态采样能提升高难度表现,说明其优势不能仅由累积暴露解释。此外,终点平滑度与节奏显著影响课程在整个难度谱中的有效性。最后,该传输视角自然支持通过几何结构学习节奏,以及拓展至非一维排序的结构化难度空间。

原文摘要 · Abstract (English)

Curriculum learning is governed by several coupled design choices---how difficulty is defined, how examples are ordered, how much exposure each level receives, and how quickly training moves across levels---making it hard to isolate what actually helps. We present Wasserstein curriculum paths, a simple transport-based framework that decouples these factors by representing curricula as trajectories of training distributions over discrete difficulty levels. Across a calibrated synthetic suite with 12 tasks and 33 difficulty axes, we use this framework to isolate the effects of ordering, matched exposure, endpoint smoothness, and pacing under fixed training budgets. We find that curriculum effects are strongly context-dependent: no single strategy dominates across tasks, difficulty axes, and budgets, and curricula mainly change where a fixed budget is spent most effectively. Within this framework, easy-to-hard ordering improves hard-level performance relative to exposure-matched static sampling, showing that the benefit is not explained by cumulative exposure alone. We further show that endpoint smoothness and pacing substantially affect where along the difficulty spectrum a curriculum is effective. Finally, we show that the same transport view naturally supports extensions to learned pacing through geometry and to structured difficulty spaces beyond one-dimensional orderings.

课程学习分布迁移优化策略难度空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。