用大模型直接预测云工作流资源与运行时间,效果超越人类专家。
LASER: Language Model Regression for Semi-Structured Workflow Resource and Runtime Estimation
- 用大模型直接处理半结构化工作流配置,避免复杂特征工程。
- 在58万+次GitHub Actions数据上,预测精度超过人类专家和现有方法。
- 通过科学记数法输出和前缀约束,提升回归生成的准确性和速度。
准确预测云工作流任务的资源消耗和运行时间对调度效率至关重要,但因其配置具有半结构化特性——包括Shell命令、工具参数、依赖图谱和层次化元数据——而难以实现。传统机器学习方法需繁琐特征工程将丰富信息转化为固定长度向量,导致关键语义丢失。我们提出LASER框架,通过在序列化的工作流配置上微调大语言模型,实现多目标资源与运行时间回归。为解决生成式回归中的数值挑战,引入科学记数法输出编码以覆盖多个数量级的目标值,并采用前缀填充的约束解码策略,在保证输出合法性的同时将推理延迟降低30%以上。进一步表明,全注意力微调在长上下文任务中优于滑动窗口模型。在大规模芯片设计工作负载及新发布的公共基准GHARuntime(基于27,000+仓库的58万+次GitHub Actions运行)上验证,LASER性能超越人类专家和主流表格型机器学习基线,展现出清晰的模型与数据扩展性,确立了大模型在半结构化工作流数据回归上的新范式。
原文摘要 · Abstract (English)
Accurate prediction of resource consumption and runtime for cloud workflow jobs is critical for scheduling efficiency, yet remains challenging due to the semi-structured nature of job configurations -- comprising shell commands, tool-specific parameters, dependency graphs, and hierarchical metadata. Traditional ML approaches require brittle feature engineering to flatten this rich information into fixed-size vectors, losing critical semantic context. We present LASER, a framework that fine-tunes LLMs on serialized workflow job configurations for multi-target resource and runtime regression. To address the challenges of numerical regression via generation, we introduce scientific notation output encoding for targets spanning multiple orders of magnitude, and constrained decoding with prefix filling to enforce output validity while reducing inference latency by over 30%. We further show that full-attention fine-tuning improves accuracy over sliding-window LLMs on long job contexts. Validated on large-scale chip design workloads, and GHARuntime, a new public benchmark derived from 580,000+ GitHub Actions runs across 27,000+ repositories, LASER outperforms human experts and SOTA tabular ML baselines, with clear model- and data-scaling behavior, establishing a new paradigm for LLM-based regression on semi-structured workflow data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。