arXiv:2606.04161cs.LG2026-06

在edX数据上,选择器无法超越最强单模型,根源是局部表征模糊。

When Offline Selectors Cannot Beat the Best Single Model: A Diagnostic Study on edX Dropout Prediction

论文配图:When Offline Selectors Cannot Beat the Best Single Model: A Diagnostic Study on edX Dropout Prediction
图 1 · 摘自论文原文
  • 通过三阶段诊断分离出失败原因:学习器、状态或标签偏移
  • 平均提升9.7个精度点的最优选择器仍被单模型超越
  • 瓶颈在于局部表征模糊,而非模型选择机制本身

不同预测器在不同输入上表现各异,实例级选择本应优于单一模型。然而,基于日志数据训练的选择器常无法超越最强单模型。三个潜在原因——学习器不匹配、状态无法预测胜者、缓冲区到部署的标签偏移——通常未被区分。本研究在共享缓冲区上采用三阶段诊断:第一阶段估算基于k-NN标签一致性的理想上限;第二阶段检验配对的BC、DQN与CQL(多种惩罚权重)是否达到该上限;第三阶段消融选择器状态,测试更丰富特征能否提升性能。结果表明,在edX点击流数据上,16个时间窗口中,理想选择器平均比最强基线模型高9.7个精度点,但BC、DQN与CQL均未达此上限(经十倍缓冲区扫描及2000个保留样本验证)。瓶颈并非保守性或分布偏移,而是局部表征模糊:CQL虽缩小模仿差距但无部署收益,遗憾聚集紧密,各学习器测试精度趋同。下一步应优化状态设计或采集新数据,而非继续调优离线学习器。

原文摘要 · Abstract (English)

Different predictors often excel on different inputs, so picking the best one per instance promises higher accuracy than committing to a single model. In practice, selectors trained from logged data routinely fail to beat the strongest single predictor. Three causes typically go unseparated before more tuning is applied: a mismatched learner, a state that does not predict which model wins, or buffer-to-deployment label shift. A three-stage diagnostic rules them out on a shared buffer. Stage~1 estimates a local ceiling on oracle recovery from $k$-NN label consistency. Stage~2 asks whether paired BC and offline-RL learners (BC, DQN, and CQL across penalty weights) reach that ceiling. Stage~3 ablates the selector state to test whether richer features would raise it. The combined verdict points to the most promising next step: tuning the learner, redesigning the state, or collecting new data. We apply it to selecting among five dropout-prediction models on edX clickstream data. Across 16 windows, the oracle beats the strongest single base model by 9.7 accuracy points on average, yet BC, DQN, and CQL land in the same test-accuracy band below it (robust to a tenfold buffer sweep and $N{=}2{,}000$ held-out examples). The bottleneck is local representational ambiguity: CQL closes the imitation gap without a deployment gain (not conservatism), regret clusters tightly across learners (not tie-breaking), and the three learners converge on test accuracy (not shift). The next iteration should change the state or collect new data, not tune the offline learner further.

模型选择离线强化学习教育数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。