用智能预测动态分配数据包队列,显著降低网络延迟峰值。
SwiftQueue: Optimizing Low-Latency Applications with Swift Packet Queuing
- 基于最近确认包延迟构建自定义Transformer模型,实现每包级延迟预测。
- 相比现有方法,延迟预测准确率提升45%-65%,尾部延迟降低36%-45%。
- 适合对延迟敏感的应用,如实时视频、在线游戏和金融交易系统。
低延迟、低丢包、可扩展吞吐量(L4S)是一种新兴的路由器队列管理技术,已在工业界逐步部署。当前的L4S采用基于流的队列选择策略,即同一流的所有数据包使用相同的队列,尽管每个包单独标记。这可能导致尾部延迟上升,因为瞬时拥塞仅影响部分包。本文提出SwiftQueue,一种新的L4S队列选择策略:发送端使用新型每包延迟预测器,识别可能产生延迟突增或下降的包。其核心思想是,许多包级延迟波动源于共享路由器队列中近期包之间的复杂交互。传统模型难以高效学习此类模式,而SwiftQueue采用定制化的Transformer架构,基于最近收到的确认包(ACK)延迟,预测下一包的延迟。根据预测结果,发送端动态标记L4S数据包头,使同一流中的包可被分配至不同队列。基于真实网络追踪数据,实验表明,与现有方法相比,SwiftQueue在延迟及变化预测上准确率提高45%-65%,并使L4S流的尾部延迟降低36%-45%。
原文摘要 · Abstract (English)
Low Latency, Low Loss, and Scalable Throughput (L4S), as an emerging router-queue management technique, has seen steady deployment in the industry. An L4S-enabled router assigns each packet to the queue based on the packet header marking. Currently, L4S employs per-flow queue selection, i.e. all packets of a flow are marked the same way and thus use the same queues, even though each packet is marked separately. However, this may hurt tail latency and latency-sensitive applications because transient congestion and queue buildups may only affect a fraction of packets in a flow. We present SwiftQueue, a new L4S queue-selection strategy in which a sender uses a novel per-packet latency predictor to pinpoint which packets likely have latency spikes or drops. The insight is that many packet-level latency variations result from complex interactions among recent packets at shared router queues. Yet, these intricate packet-level latency patterns are hard to learn efficiently by traditional models. Instead, SwiftQueue uses a custom Transformer, which is well-studied for its expressiveness on sequential patterns, to predict the next packet's latency based on the latencies of recently received ACKs. Based on the predicted latency of each outgoing packet, SwiftQueue's sender dynamically marks the L4S packet header to assign packets to potentially different queues, even within the same flow. Using real network traces, we show that SwiftQueue is 45-65% more accurate in predicting latency and its variations than state-of-art methods. Based on its latency prediction, SwiftQueue reduces the tail latency for L4S-enabled flows by 36-45%, compared with the existing L4S queue-selection method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。