用可解释的Transformer预测延迟,自动调优云资源以保服务达标
Leveraging Interpretability in the Transformer to Automate the Proactive Scaling of Cloud Resources
- 基于TFT模型建模请求、资源与端到端延迟的关系
- 预测延迟偏离时,通过特征重要性生成调优参数
- 适合云平台运维和SRE团队参考,提升资源利用率
现代Web服务采用云原生架构以利用微服务的优势。为持续保障高质量服务(QoS),满足服务等级协议(SLA)要求、提升用户体验并降低运营成本,每个微服务必须配置恰当的资源。然而,准确分配资源极为复杂,受工作负载强度及微服务间复杂依赖关系影响。为此,我们构建了一个模型,捕捉端到端延迟、前端请求量与资源利用率之间的关系,并利用该模型预测端到端延迟。解决方案采用具备可解释性的基于注意力的架构Temporal Fusion Transformer(TFT)。当预测显示可能违反SLA时,我们使用TFT提供的特征重要性作为核岭回归(KRR)的协变量,响应变量为期望延迟,学习与特征重要性相关的参数。这些参数反映了为确保SLA合规所需对特征进行的调整。我们在一个基于微服务的应用上验证了该方法的有效性,并提供了部署路线图。
原文摘要 · Abstract (English)
Modern web services adopt cloud-native principles to leverage the advantages of microservices. To consistently guarantee high Quality of Service (QoS) according to Service Level Agreements (SLAs), ensure satisfactory user experiences, and minimize operational costs, each microservice must be provisioned with the right amount of resources. However, accurately provisioning microservices with adequate resources is complex and depends on many factors, including workload intensity and the complex interconnections between microservices. To address this challenge, we develop a model that captures the relationship between an end-to-end latency, requests at the front-end level, and resource utilization. We then use the developed model to predict the end-to-end latency. Our solution leverages the Temporal Fusion Transformer (TFT), an attention-based architecture equipped with interpretability features. When the prediction results indicate SLA non-compliance, we use the feature importance provided by the TFT as covariates in Kernel Ridge Regression (KRR), with the response variable being the desired latency, to learn the parameters associated with the feature importance. These learned parameters reflect the adjustments required to the features to ensure SLA compliance. We demonstrate the merit of our approach with a microservice-based application and provide a roadmap to deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。