用强化学习提升地铁事件预测精度,比数学模型更有效。
Do Math Reasoning LLMs Help Predict the Impact of Public Transit Events?
- 设计容差奖励机制,让模型在误差范围内获部分得分
- 在纽约地铁数据上实现5分钟准确率提升35%
- 适合需要处理模糊现实文本的交通预测场景
从非结构化文本警报中预测公共交通事件持续时间是一项关键但具有挑战性的任务。传统监督微调因领域数据稀疏、标签噪声和缺乏可靠推理示范而难以应用。尽管基于可验证奖励的强化学习(RLVR)在数学等二值正确性任务中表现优异,但其在噪声连续预测任务中的适用性仍不明确。本文首次将RLVR引入公共交通运营的实时预测挑战。通过引入基于容差的形塑奖励函数,在连续误差范围内给予部分奖励,而非要求单一正确答案。我们在整理的纽约MTA服务警报数据集上系统评估该框架。结果表明,通用指令微调大模型显著优于专用数学推理模型,后者在真实世界模糊文本上表现不佳。我们实证证明二值奖励不稳定且降低性能,而形塑奖励设计至关重要,使模型在最具挑战性的指标上领先。虽然经典回归器在整体MAE或MSE上更优,但我们的RLVR方法在5分钟准确率(Acc@5)上相较最强基线实现35%相对提升。这表明RLVR可成功适配真实世界噪声预测任务,但需设计反映问题连续性的验证器。
原文摘要 · Abstract (English)
Predicting public transit incident duration from unstructured text alerts is a critical but challenging task. Addressing the domain sparsity of transit operations with standard Supervised Fine-Tuning (SFT) is difficult, as the task involves noisy, continuous labels and lacks reliable expert demonstrations for reasoning. While Reinforcement Learning from Verifiable Rewards (RLVR) excels at tasks with binary correctness, like mathematics, its applicability to noisy, continuous forecasting is an open question. This work, to our knowledge, is the first to bridge the gap between RLVR LLM training with the critical, real-world forecasting challenges in public transit operations. We adapt RLVR to this task by introducing a tolerance-based, shaped reward function that grants partial credit within a continuous error margin, rather than demanding a single correct answer. We systematically evaluate this framework on a curated dataset of NYC MTA service alerts. Our findings show that general-purpose, instruction-tuned LLMs significantly outperform specialized math-reasoning models, which struggle with the ambiguous, real-world text. We empirically demonstrate that the binary reward is unstable and degrades performance, whereas our shaped reward design is critical and allows our model to dominate on the most challenging metrics. While classical regressors are superior at minimizing overall MAE or MSE, our RLVR approach achieved a 35\% relative improvement in 5-minute accuracy (Acc@5) over the strongest baseline. This demonstrates that RLVR can be successfully adapted to real-world, noisy forecasting, but requires a verifier design that reflects the continuous nature of the problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。