arXiv:2603.02109eess.SPcs.LG2026-03被引 1

通过通信计算重叠,提升多模态神经网络在无线边缘的推理速度。

Orchestrating Multimodal DNN Workloads in Wireless Neural Processing

  • 提出通信计算一体化模型,实现无线传输与加速器调度协同优化。
  • PACS算法通过流水线重叠通信与计算,显著降低高异构场景下的延迟。
  • 适合研究无线边缘推理、多模态AI系统设计的开发者与研究人员。

在边缘推理中,无线资源分配与加速器级深度神经网络(DNN)调度尚未以端到端方式协同优化。无线传输与加速器级DNN执行之间的缺乏协调导致无法有效重叠,从而增加端到端推理延迟。为此,本文研究无线神经处理(WNP)中的多模态DNN工作负载编排,该范式将无线传输与多核加速器执行整合为统一的端到端流程。首先,我们构建了多模态DNN执行的统一通信-计算模型,并建立了相应的优化问题。其次,提出O-WiN框架,通过仿真优化与运行时执行两个紧密耦合阶段实现工作负载编排。第三,开发两种算法:RTFS按顺序调度通信与计算,而PACS则交错调度,通过重叠无线数据传输与加速器级DNN执行实现流水线并行。仿真结果表明,在高模态异构性下,PACS显著优于RTFS,通过通信-计算重叠更有效地隐藏无线延迟,凸显了通信-计算流水线在加速多模态DNN执行方面的有效性。

原文摘要 · Abstract (English)

In edge inference, wireless resource allocation and accelerator-level deep neural network (DNN) scheduling have yet to be co-optimized in an end-to-end manner. The lack of coordination between wireless transmission and accelerator-level DNN execution prevents efficient overlap, leading to higher end-to-end inference latency. To address this issue, this paper investigates multimodal DNN workload orchestration in wireless neural processing (WNP), a paradigm that integrates wireless transmission and multi-core accelerator execution into a unified end-to-end pipeline. First, we develop a unified communication-computation model for multimodal DNN execution and formulate the corresponding optimization problem. Second, we propose O-WiN, a framework that orchestrates DNN workloads in WNP through two tightly coupled stages: simulation-based optimization and runtime execution. Third, we develop two algorithms, RTFS and PACS. RTFS schedules communication and computation sequentially, whereas PACS interleaves them to enable pipeline parallelism by overlapping wireless data transfer with accelerator-level DNN execution. Simulation results demonstrate that PACS significantly outperforms RTFS under high modality heterogeneity by better masking wireless latency through communication-computation overlap, thereby highlighting the effectiveness of communication-computation pipelining in accelerating multimodal DNN execution in WNP.

边缘计算多模态流水线并行无线神经处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。