用预测调度混合实例,低成本高效完成大模型微调。
Deadline-Aware Online Scheduling for LLM Fine-Tuning with Spot Market Predictions
- 结合价格与可用性预测,动态分配现货与按需实例。
- 实测可提升54.8%效率,显著优于传统调度方案。
- 适合追求成本优化的大模型训练团队使用。
随着基础模型规模增大,微调成本急剧上升。尽管GPU现货实例可降低费用,但其价格和可用性的波动使带截止时间的调度极具挑战。本文提出混合使用现货与按需实例的策略,首次证明现货市场在价格与可用性上具有可预测性,并揭示预测对成本调度的关键作用及其对误差的敏感性。建立整数规划模型以捕捉混合实例在价格与可用性动态下的使用。设计基于承诺时域控制的在线分配算法,利用‘承诺水平’约束部分决策序列。当预测不准确时,进一步提出无需预测的互补算法。开发在线策略选择算法,从两算法参数变化生成的池中学习最优策略。理论证明:预测算法性能界随预测误差减小而收紧;策略选择算法具有$/mathcal{O}( ext{sqrt}(T))$的遗憾界。实验表明,该在线框架能自适应不同市场动态与预测质量,持续优于基线,最高提升效用54.8%。
原文摘要 · Abstract (English)
As foundation models grow in size, fine-tuning them becomes increasingly expensive. While GPU spot instances offer a low-cost alternative to on-demand resources, their volatile prices and availability make deadline-aware scheduling particularly challenging. We tackle this difficulty by using a mix of spot and on-demand instances. Distinctively, we show the predictability of prices and availability in a spot instance market, the power of prediction in enabling cost-efficient scheduling and its sensitivity to estimation errors. An integer programming problem is formulated to capture the use of mixed instances under both the price and availability dynamics. We propose an online allocation algorithm with prediction based on the committed horizon control approach that leverages a \emph{commitment level} to enforce the partial sequence of decisions. When this prediction becomes inaccurate, we further present a complementary online algorithm without predictions. An online policy selection algorithm is developed that learns the best policy from a pool constructed by varying the parameters of both algorithms. We prove that the prediction-based algorithm achieves tighter performance bounds as prediction error decreases, while the policy selection algorithm possesses a regret bound of $\mathcal{O}(\sqrt{T})$. Experimental results demonstrate that our online framework can adaptively select the best policy under varying spot market dynamics and prediction quality, consistently outperforming baselines and improving utility by up to 54.8\%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。