arXiv:2507.12908cs.LG2025-07被引 8

Fremer通过频域优化实现高效精准的云工作负载预测。

Fremer: Lightweight and Effective Frequency Transformer for Workload Forecasting in Cloud Services

  • 在频域处理工作负载周期性,提升Transformer模型效率
  • 比现有最优模型平均降低5.5% MSE、4.7% MAE、8.6% SMAPE
  • 适合需要低延迟、低资源消耗的云服务自动扩缩容场景

工作负载预测对云服务中的自动扩缩容与调度至关重要,直接影响运营效率。尽管基于Transformer的预测模型在通用任务中表现优异,但在大规模云环境下的计算效率常不达标。由于多数工作负载序列具有复杂的周期性特征,从频域角度解决此问题具有显著优势。为此,我们提出Fremer——一种高效且精准的深度预测模型。Fremer满足三大关键需求:具备卓越效率,优于多数Transformer模型;达到顶尖精度,超越所有现有最优(SOTA)模型;对多周期序列表现稳健。此外,我们收集并开源了四个来自字节跳动云服务的高质量工作负载数据集,涵盖数千个计算实例的数据。在自研数据集和公开基准上的大量实验表明,Fremer持续优于基线模型,在均方误差(MSE)、平均绝对误差(MAE)和对称平均绝对百分比误差(SMAPE)上分别取得5.5%、4.7%、8.6%的平均改进,同时减少参数量与计算开销。在基于Kubernetes的主动自动扩缩容测试中,Fremer将平均延迟降低18.78%,资源消耗减少2.35%,充分验证其在真实场景中的有效性。

原文摘要 · Abstract (English)

Workload forecasting is pivotal in cloud service applications, such as auto-scaling and scheduling, with profound implications for operational efficiency. Although Transformer-based forecasting models have demonstrated remarkable success in general tasks, their computational efficiency often falls short of the stringent requirements in large-scale cloud environments. Given that most workload series exhibit complicated periodic patterns, addressing these challenges in the frequency domain offers substantial advantages. To this end, we propose Fremer, an efficient and effective deep forecasting model. Fremer fulfills three critical requirements: it demonstrates superior efficiency, outperforming most Transformer-based forecasting models; it achieves exceptional accuracy, surpassing all state-of-the-art (SOTA) models in workload forecasting; and it exhibits robust performance for multi-period series. Furthermore, we collect and open-source four high-quality, open-source workload datasets derived from ByteDance's cloud services, encompassing workload data from thousands of computing instances. Extensive experiments on both our proprietary datasets and public benchmarks demonstrate that Fremer consistently outperforms baseline models, achieving average improvements of 5.5% in MSE, 4.7% in MAE, and 8.6% in SMAPE over SOTA models, while simultaneously reducing parameter scale and computational costs. Additionally, in a proactive auto-scaling test based on Kubernetes, Fremer improves average latency by 18.78% and reduces resource consumption by 2.35%, underscoring its practical efficacy in real-world applications.

工作负载预测Transformer频域建模云服务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。