用大模型生成逼真微服务调用图,提升系统管理效率
Large Language Models as Realistic Microservice Trace Generators
- 用递归生成方式让大模型分步构建复杂调用图
- 生成的追踪数据在准确性和真实性上超越现有方法
- 适合系统优化、故障预测等微服务场景使用
工作负载追踪对理解复杂计算机系统行为和管理计算与内存资源至关重要。由于真实追踪数据难以获取,合成追踪生成成为有前景的替代方案。本文提出首个基于大语言模型(LLM)生成合成工作负载追踪的方法,专注于微服务调用图生成。为捕捉其复杂的层级结构和隐含约束,我们设计递归训练机制,将调用图生成分解为更易处理的步骤。为进一步强化追踪特征学习并生成罕见场景,引入额外指令微调以对齐目标追踪属性。通过该方法,我们训练出TraceLLM——一个用于微服务追踪生成的大型语言模型,并证明其在多种条件下均能生成多样且逼真的追踪数据,在准确性和有效性上优于现有方法。合成追踪可有效替代真实数据,优化关键微服务管理任务。此外,TraceLLM还能适应下游任务,如预测关键追踪特征和补全缺失数据。
原文摘要 · Abstract (English)
Workload traces are essential to understand complex computer systems' behavior and manage processing and memory resources. Since real-world traces are hard to obtain, synthetic trace generation is a promising alternative. This paper proposes a first-of-a-kind approach that relies on training a large language model (LLM) to generate synthetic workload traces, specifically microservice call graphs. To capture complex and arbitrary hierarchical structures and implicit constraints in such traces, we propose to train LLMs to generate recursively, making call graph generation a sequence of more manageable steps. To further enforce learning constraints on the traces and generate uncommon situations, we apply additional instruction tuning steps to align our model with the desired trace features. With this method, we train TraceLLM, an LLM for microservice trace generation, and demonstrate that it produces diverse, realistic traces under varied conditions, outperforming existing approaches in both accuracy and validity. The synthetically generated traces can effectively replace real data to optimize important microservice management tasks. Additionally, TraceLLM adapts to downstream trace-related tasks, such as predicting key trace features and infilling missing data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。