arXiv:2506.02002cs.DCcs.LG2025-06

用机器学习分析分布式系统数据不一致故障的影响

Machine Learning for Consistency Violation Faults Analysis

  • 基于程序状态转移秩分析不一致故障的传播机制
  • 在3到10节点的小图上训练模型,测试误差为1.5
  • 适合研究分布式系统可靠性与故障分析的开发者

分布式系统常出现一致性违反故障(CVFs),即节点操作过时或错误数据,影响收敛与整体性能。本文以戴克斯特拉令牌环问题为例,提出基于机器学习的分析方法,通过计算程序状态转移秩及其影响,量化CVFs对系统行为的作用。为应对大规模图导致的状态空间爆炸问题,构建了前馈神经网络(FNN)和基于TensorFlow分布式API的模型,利用3至10节点小图生成的数据进行训练,预测决定秩效应的关键参数。实验显示测试损失为4.39,平均绝对误差为1.5。尽管在CPU上分布式训练未显著提升速度,但结果表明使用GPU或TPU等加速硬件可提升可扩展性。

原文摘要 · Abstract (English)

Distributed systems frequently encounter consistency violation faults (cvfs), where nodes operate on outdated or inaccurate data, adversely affecting convergence and overall system performance. This study presents a machine learning-based approach for analyzing the impact of CVFs, using Dijkstra's Token Ring problem as a case study. By computing program transition ranks and their corresponding effects, the proposed method quantifies the influence of cvfs on system behavior. To address the state space explosion encountered in larger graphs, two models are implemented: a Feedforward Neural Network (FNN) and a distributed neural network leveraging TensorFlow's \texttt{tf.distribute} API. These models are trained on datasets generated from smaller graphs (3 to 10 nodes) to predict parameters essential for determining rank effects. Experimental results demonstrate promising performance, with a test loss of 4.39 and a mean absolute error of 1.5. Although distributed training on a CPU did not yield significant speed improvements over a single-device setup, the findings suggest that scalability could be enhanced through the use of advanced hardware accelerators such as GPUs or TPUs.

分布式系统故障分析机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。