将网络规则融入生成模型,让机器学习更可信、更可控。
Making Logic a First-Class Citizen in Generative ML for Networking
- 用数据自动提取网络规则,再筛选有意义的逻辑条目。
- 结合SMT求解器与生成模型,强制输出符合规则,提升可靠性。
- 适合需要高可信度生成结果的网络诊断与仿真场景。
生成式机器学习模型在遥测补全、预测和合成流量生成等网络任务中日益流行。然而,它们存在两大缺陷:(i) 输出常违反已知网络规律,降低可信度;(ii) 难以控制,微小改动也需重新训练。为此,本文提出一种新范式,将一阶逻辑规则作为显式网络知识融入生成模型。规则捕捉观测信号间的已知关系,如延迟增加先于丢包。尽管概念简单,实现困难——网络知识极少被形式化为规则,且直接注入规则常损害模型性能。本文提出NetNomos,一个三阶段框架:(i) 从数据(如测量值)中学习规则;(ii) 过滤出语义有意义的规则;(iii) 通过生成模型与满足性模理论(SMT)求解器协同推理,强制执行规则。我们在四个不同网络数据集上进行组件级与端到端评估。结果显示,NetNomos从四个真实数据集学习到多样且有意义的规则,比当前最优的DuoAI方法提升1.6–6.5倍可扩展性。在通用GPT-2模型上强制执行规则后,其在遥测补全、流量预测和合成数据生成三项任务上的表现达到或超过专用的SOTA系统(如Zoom2Net、NetShare)。
原文摘要 · Abstract (English)
Generative ML models are increasingly popular in networking for tasks such as telemetry imputation, prediction, and synthetic trace generation. Despite their capabilities, they suffer from two shortcomings: \emph{(i)} their output is often visibly violating well-known networking rules, which undermines their trustworthiness; and \emph{(ii)} they are difficult to control, frequently requiring retraining even for minor changes. To address these limitations and unlock the benefits of generative models for networking, we propose a new paradigm for integrating explicit network knowledge, in the form of first-order logic rules, into ML models used for networking tasks. Rules capture well-known relationships among observed signals, e.g., that increased latency precedes packet loss. While the idea is conceptually straightforward, its realization is challenging: networking knowledge is rarely formalized into rules, and naively injecting rules into ML models often hampers their effectiveness. This paper introduces NetNomos, a multi-stage framework that \emph{(i)} learns rules directly from data (e.g., measurements); \emph{(ii)} filters them to select semantically meaningful ones; and \emph{(iii)} enforces them through collaborative generation between an ML model and a Satisfiability Modulo Theories (SMT) solver. %We evaluate NetNomos both component-wise and end-to-end across four diverse network datasets. We show that NetNomos learns diverse, meaningful rules from four real-world datasets and is 1.6--6.5$\times$ more scalable than DuoAI, a state-of-the-art (SOTA) rule-learning method. By enforcing these rules on a generic GPT-2 model, NetNomos achieves performance on par with or even surpassing specialized SOTA systems such as Zoom2Net and NetShare across three networking tasks: telemetry imputation, traffic forecasting, and synthetic data generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。