Pegasus让网络数据平面高效运行各类深度模型,精度更高、规模更大。
Pegasus: A Universal Framework for Scalable Deep Learning Inference on the Dataplane
- 用分、映射、归约三类原语重构深度学习推理流程
- 精度提升最高22.8%,模型规模扩至248倍,输入规模扩至212倍
- 适合需要高速智能分析的网络场景,如实时流量识别
智能数据平面(IDP)将深度学习(DL)模型部署在网路数据平面,实现线速智能流量分析。但当前基于匹配-动作表(MAT)的抽象与深度学习推理不匹配,导致精度下降、规模受限、通用性差。本文提出Pegasus框架,将深度学习操作转换为三个面向数据平面的原语:分割(Partition)、映射(Map)和求和归约(SumReduce)。其中,分割将高维特征拆分为多个低维向量,便于数据平面处理;映射通过模糊匹配并行计算低维向量;求和归约整合计算结果。此外,采用原语融合技术提升可扩展性,并使用全精度权重与定点激活以提高精度。在P4交换机上的实现表明,Pegasus可有效支持MLP、RNN、CNN及自编码器等多类模型。相比现有方法,平均精度提升最高达22.8%,模型规模扩大至248倍,输入规模扩大至212倍。
原文摘要 · Abstract (English)
The paradigm of Intelligent DataPlane (IDP) embeds deep learning (DL) models on the network dataplane to enable intelligent traffic analysis at line-speed. However, the current use of the match-action table (MAT) abstraction on the dataplane is misaligned with DL inference, leading to several key limitations, including accuracy degradation, limited scale, and lack of generality. This paper proposes Pegasus to address these limitations. Pegasus translates DL operations into three dataplane-oriented primitives to achieve generality: Partition, Map, and SumReduce. Specifically, Partition "divides" high-dimensional features into multiple low-dimensional vectors, making them more suitable for the dataplane; Map "conquers" computations on the low-dimensional vectors in parallel with the technique of fuzzy matching, while SumReduce "combines" the computation results. Additionally, Pegasus employs Primitive Fusion to merge computations, improving scalability. Finally, Pegasus adopts full precision weights with fixed-point activations to improve accuracy. Our implementation on a P4 switch demonstrates that Pegasus can effectively support various types of DL models, including Multi-Layer Perceptron (MLP), Recurrent Neural Network (RNN), Convolutional Neural Network (CNN), and AutoEncoder models on the dataplane. Meanwhile, Pegasus outperforms state-of-the-art approaches with an average accuracy improvement of up to 22.8%, along with up to 248x larger model size and 212x larger input scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。