arXiv:2605.00515cs.DCcs.AI2026-05被引 3

将专家模型分布式部署在卫星网络,实现低延迟大模型推理。

SpaceMoE: Realizing Distributed Mixture-of-Experts Inference over Space Networks

论文配图:SpaceMoE: Realizing Distributed Mixture-of-Experts Inference over Space Networks
图 1 · 摘自论文原文
  • 分层+专家级双层调度,按轨道划分子网部署MoE层
  • 实验显示相比随机策略降低3倍以上延迟
  • 适合高延迟太空环境下的AI模型高效部署

利用高效连续的太阳能供能,空间数据中心被视为执行能耗密集型大语言模型(LLMs)的潜在平台。然而,在卫星网络中高效分布部署大规模LLM面临计算与通信资源受限的挑战。为此,我们提出面向空间网络的混合专家模型(SpaceMoE)框架,支持流行的混合专家(MoE)模型在轨分布式执行。该框架采用两级部署策略:(1)层部署,将MoE层映射至沿轨道方向划分的卫星子网;(2)层内专家部署,将激活概率不同的专家分配至同一层对应的卫星。基于自回归推理的环形通信模式,将卫星星座沿轨道方向划分为环状子网,每组负责一个MoE层。在此基础上,建立并求解层内专家部署优化问题,发现核心原则:高频激活专家应部署于预期延迟最低的路由路径卫星上。在千星星座上的实验表明,SpaceMoE相较传统随机与消融策略,至少实现三倍延迟降低。

原文摘要 · Abstract (English)

Leveraging continuous solar energy harvesting at high efficiency, space data centers are envisioned as a promising platform for executing energy-intensive large language models (LLMs). Recognizing this advantage, space and AI conglomerates (e.g., SpaceX, Google) are actively investing in this vision. One key challenge, however, is the efficient distributed deployment of a large-scale LLM in a satellite network due to the limited onboard computing and communication resources. This gives rise to a placement problem that involves partitioning and mapping model components to satellites such that the fundamentally different model architecture and network topology can be reconciled to ensure low-latency token generation. To address this problem, we present the Space Network of Mixture-of-Experts (SpaceMoE) framework targeting the distributed execution of a popular mixture-of-experts (MoE) model in space. The proposed placement strategies are two-level: (1) layer placement, which assigns MoE layers to satellite subnets; and (2) intra-layer expert placement, which assigns individual experts to satellites associated with the same layer/subnet. For layer placement, we exploit the ring-like communication pattern of autoregressive inference to partition the satellite constellation along the orbiting direction into subnets arranged on a ring, each hosting one MoE layer. Based on this architecture, we formulate and solve an optimization problem for intra-layer expert placement to map experts with heterogeneous activation probabilities onto satellites. The derived strategy reveals an intuitive principle: a frequently activated expert should be mapped to a satellite on a routing path with low expected latency. Experiments over a thousand-satellite constellation show that SpaceMoE achieves at least a threefold latency reduction compared with conventional random and ablation-based placement strategies.

MoE卫星网络分布式推理低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。