arXiv:2607.18984cs.CL2026-07中稿 · EMNLP

为NLP中的课程学习提供可系统分析的分类框架

Disentangling Curriculum Learning in NLP: Towards a Unifying Taxonomy

论文配图:Disentangling Curriculum Learning in NLP: Towards a Unifying Taxonomy
图 1 · 摘自论文原文
  • 将难度评估与训练调度分离,厘清不同难度定义
  • 首次形式化课程调度器,引入保留机制和单调性属性
  • 揭示以往研究因混淆概念导致结果不可比,适合方法设计者

尽管自然语言处理领域对课程学习(CL)的研究已超过十年,但尚无明确指导:面对特定问题时应选择何种难度函数或调度策略。为理解阻碍进展的原因,本文提出一个细粒度分类框架,将难度评估与训练调度解耦,实现对CL策略的系统分析。在难度评估方面,区分了来源归属与任务依赖性,揭示难度是一种视角性概念,反映了对实例难学原因的不同假设;在调度方面,首次以期望训练贡献为基准形式化了CL调度器,通过引入保留机制和单调性属性,实现跨实现方式的比较。应用于对现有NLP中CL研究的专项分析后,该分类框架揭示了一个系统性不可比问题:先前工作常混淆不同的难度与调度概念,往往在不同目标下使用相同的CL标签——阻碍了对比与证据体系的积累。除诊断外,该框架支持新策略的设计、分析与比较,并推动剥离改进来源的评估实践。

原文摘要 · Abstract (English)

Despite more than a decade of curriculum learning (CL) research in NLP, the field lacks a principled account of which difficulty function or scheduler to use for a given problem. To understand what has hindered progress towards this account, we propose a fine-grained taxonomy separating difficulty evaluation from training scheduling to enable systematic analysis of CL strategies. For difficulty evaluation, we distinguish attribution source and task dependence, revealing difficulty as a perspectival concept encoding different assumptions about what makes an instance hard to learn. For scheduling, we provide the first formalisation of CL schedulers in terms of expected training contribution, enabling comparison across implementations by introducing retention regimes and monotonicity properties. Applied in a dedicated analysis of CL works in NLP, our taxonomy reveals a systematic incomparability problem: prior works conflate distinct notions of difficulty and scheduling, often pursuing different objectives under the same CL label -- hindering comparison and the accumulation of a coherent evidence base. Beyond diagnosis, the taxonomy supports the design, analysis, and comparison of CL strategies, and motivates evaluation practices that disentangle the sources of observed improvement.

课程学习分类框架NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。