分离流量与资源特征,提升微服务尾延迟预测精度。
Reliable Microservice Tail Latency Prediction via Decoupled Dual-Stream Learning and Gradient Modulation
- 双流架构分别建模服务依赖流量和资源动态
- 在真实数据集上相对最优基线降低15.62%~26.11%的MAPE
- 适合关注云原生系统性能监控与优化的研发人员
微服务架构支持可扩展的云原生应用,但其分布式特性使得严格满足服务等级目标(SLO)变得困难。准确预测窗口级P95尾延迟仍具挑战性,源于软件工作负载传播与基础设施资源限制之间的复杂交互。现有模型因未显式分离流量指标与资源指标,导致特征表示错位。统一架构无法区分级联服务依赖与局部处理能力,联合训练时资源特征收敛过快并主导梯度更新,阻碍对底层软件拓扑的学习。为此,本文提出USRFNet,一种双流框架,将需求与容量建模解耦。该框架使用图神经网络建模跨服务依赖的流量空间交互,用门控MLP独立提取基础设施资源动态,并通过分层张量融合整合表示。为解决训练不平衡问题,引入可靠性感知梯度调制策略,基于各数据流的泛化比率动态重标度梯度。在三个大规模真实世界基准上的实验表明,USRFNet在预测精度上优于现有最优方法,相比最佳基线,相对MAPE降低15.62%至26.11%。
原文摘要 · Abstract (English)
Microservice architectures enable scalable cloud-native applications; however, the distributed nature of these systems complicates the maintenance of strict Service Level Objectives. Accurately predicting window-level P95 tail latency remains difficult due to the complex interactions between software workload propagation and infrastructure resource limits. Existing predictive models struggle to capture these dynamics because the lack of explicit separation between traffic metrics and resource metrics causes misaligned feature representations. Building on this suboptimal data treatment, the unified architectures of prior approaches fail to isolate cascading service dependencies from localized processing capacity. Due to this entanglement, joint training suffers from an optimization imbalance wherein resource features converge faster and dominate gradient updates, thereby preventing the learning of underlying software topologies. To address these challenges, we propose USRFNet, a dual-stream framework that separates the modeling of demand and capacity. The proposed framework utilizes a Graph Neural Network to model the spatial interactions of traffic workloads across software-level service dependencies, and a gating MLP to independently extract infrastructure-level resource dynamics. The model then integrates these representations through hierarchical tensor fusion. To resolve the training imbalance, we introduce a Reliability-Aware Gradient Modulation strategy that dynamically rescales gradients based on the generalization ratio of each data stream. Experiments on three large-scale real-world benchmarks demonstrate that USRFNet outperforms state-of-the-art methods in prediction accuracy. Specifically, compared to the best-performing baselines, the proposed framework achieves relative MAPE reductions ranging from 15.62% to 26.11% across the evaluated datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。