arXiv:2609.06806cs.LGcs.CL2026-09

主动学习中动态切换训练方式,提升效率与模型校准性。

Train Smarter, Not Harder: Switching Signal-Guided Training in Active Learning

论文配图:Train Smarter, Not Harder: Switching Signal-Guided Training in Active Learning
图 1 · 摘自论文原文
  • 根据模型稳定性信号自动在重训与微调间切换
  • 相比固定轮次切换,减少49%训练时间且保持性能不降
  • 适合追求高效训练与可靠置信度估计的研究者

训练策略——即是否从头训练或基于之前检查点微调——在主动学习中常被忽视。我们发现该选择具有可利用的结构:早期阶段重训更有效,因每批数据可显著改变标注分布;当模型轨迹趋于稳定后,微调更安全。为此提出 HybridAL,一种自适应训练调度方法,通过监测在线稳定性信号,在持续稳定后由重训切换至微调。两种互补信号——谱指数变化 Δα(基于权重)和准确率变化 ΔAcc(基于验证集)——覆盖时间-校准权衡的不同点。在三个编码器骨干网络和六个文本分类任务上(每项五次随机种子),HybridAL 在终点宏F1上与重训和微调相当(差距不超过0.010),节省最高达49%的重训时间,并在负对数似然(NLL)指标上恢复了重训的大部分校准优势。相比预设轮次切换的方案,HybridAL 在适度增加成本下获得更低的NLL,表明基于轨迹的动态切换比固定早期切换提供了更强的时间-校准权衡。

原文摘要 · Abstract (English)

Training strategy, namely whether to retrain from scratch or fine-tune from the previous checkpoint, is an overlooked decision variable in active learning. We show that this choice has exploitable structure: retraining is most useful in early rounds, when each batch can substantially reshape the labeled distribution, while fine-tuning becomes safer once the model trajectory stabilizes. We propose HybridAL, an adaptive training schedule that monitors an online stabilization signal and switches from retraining to fine-tuning after sustained stabilization. Two complementary signals, spectral exponent change $\Delta\alpha$ (weight-based) and accuracy change $\Delta$Acc (validation-based), span different points on the time-calibration trade-off. Across three encoder backbones and six text-classification tasks (five seeds each), HybridAL keeps endpoint macro-F1 non-inferior to retraining and fine-tuning at a 0.010 margin, saves up to 49% of retraining time, and recovers a substantial fraction of retraining's calibration advantage as measured by negative log-likelihood (NLL). Compared with schedules that switch at a pre-committed round, HybridAL obtains lower NLL at moderate additional cost, showing that trajectory-dependent switching provides a stronger time-calibration trade-off than fixed early switching.

主动学习训练策略模型校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。