用大模型让超算调度同时优化多个目标,还能解释决策过程。
Evaluating the Efficacy of LLM-Based Reasoning for Multiobjective HPC Job Scheduling
- 用大模型+自然语言推理实现可解释的动态调度
- 在7种真实负载下平衡了工期、等待时间与资源利用率
- 适合研究智能调度或对决策透明度有要求的场景
高性能计算(HPC)作业调度需权衡最小化完工时间、减少等待时长、优化资源利用和确保公平性等多重目标。传统方法如先到先服务(FCFS)、最短作业优先(SJF)或谷歌 OR-Tools 等优化技术,难以适应动态负载,且无法同时优化多目标。本文提出一种基于大语言模型(LLM)的调度器,采用 ReAct 框架(推理+行动),支持迭代式、可解释的决策。系统通过草稿内存记录调度历史,并利用自然语言反馈优化决策,约束强化模块保障可行性与安全性。我们在 OpenAI O4-Mini 与 Anthropic Claude 3.7 上,针对包含异构混合、突发模式及对抗性场景在内的七类真实 HPC 工作负载进行评估,对比 FCFS、SJF 与 OR-Tools(10至100个任务)。结果表明,该方法能有效平衡多目标,提供自然语言推理轨迹,满足约束并适应多样负载,无需领域特定训练。但推理质量与计算开销存在权衡,限制实时部署。本工作首次全面研究具备推理能力的 LLM 在 HPC 调度中的应用,展示其处理复杂多目标优化的潜力,同时揭示计算效率瓶颈。
原文摘要 · Abstract (English)
High-Performance Computing (HPC) job scheduling involves balancing conflicting objectives such as minimizing makespan, reducing wait times, optimizing resource use, and ensuring fairness. Traditional methods, including heuristic-based, e.g., First-Come-First-Served (FJFS) and Shortest Job First (SJF), or intensive optimization techniques, often lack adaptability to dynamic workloads and, more importantly, cannot simultaneously optimize multiple objectives in HPC systems. To address this, we propose a novel Large Language Model (LLM)-based scheduler using a ReAct-style framework (Reason + Act), enabling iterative, interpretable decision-making. The system incorporates a scratchpad memory to track scheduling history and refine decisions via natural language feedback, while a constraint enforcement module ensures feasibility and safety. We evaluate our approach using OpenAI's O4-Mini and Anthropic's Claude 3.7 across seven real-world HPC workload scenarios, including heterogeneous mixes, bursty patterns, and adversarial cases etc. Comparisons against FCFS, SJF, and Google OR-Tools (on 10 to 100 jobs) reveal that LLM-based scheduling effectively balances multiple objectives while offering transparent reasoning through natural language traces. The method excels in constraint satisfaction and adapts to diverse workloads without domain-specific training. However, a trade-off between reasoning quality and computational overhead challenges real-time deployment. This work presents the first comprehensive study of reasoning-capable LLMs for HPC scheduling, demonstrating their potential to handle multiobjective optimization while highlighting limitations in computational efficiency. The findings provide insights into leveraging advanced language models for complex scheduling problems in dynamic HPC environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。