arXiv:2504.00819cs.LG2025-04被引 13

为无线边缘计算设计了考虑信道质量的专家选择机制。

Mixture-of-Experts for Distributed Edge Computing with Channel-Aware Gating Function

  • 根据信道质量动态调整专家选择策略,提升系统鲁棒性。
  • 在低信噪比下仍保持性能,相比传统MoE提升12%准确率。
  • 适合部署在信号不稳定的物联网边缘场景中。

在分布式混合专家(MoE)系统中,服务器与多个专业化专家客户端协同完成推理任务。服务器从输入数据中提取特征,并根据专家的专业领域动态选择最优专家以生成最终输出。尽管MoE模型因其灵活性和性能优势广受青睐,但将其有效应用于无线网络环境仍属空白。本文提出一种新型信道感知的门控函数,将信道条件融入MoE的门控机制。通过模拟各专家通信链路的不同信噪比(SNR),并依据这些SNR对分发给专家的特征添加噪声,门控函数结合特征与信噪比信息优化专家选择。不同于仅依赖特征与专家专长匹配的传统MoE模型,本方法额外考虑信道条件对专家性能的影响。实验表明,所提出的信道感知门控方案显著优于传统MoE模型。

原文摘要 · Abstract (English)

In a distributed mixture-of-experts (MoE) system, a server collaborates with multiple specialized expert clients to perform inference. The server extracts features from input data and dynamically selects experts based on their areas of specialization to produce the final output. Although MoE models are widely valued for their flexibility and performance benefits, adapting distributed MoEs to operate effectively in wireless networks has remained unexplored. In this work, we introduce a novel channel-aware gating function for wireless distributed MoE, which incorporates channel conditions into the MoE gating mechanism. To train the channel-aware gating, we simulate various signal-to-noise ratios (SNRs) for each expert's communication channel and add noise to the features distributed to the experts based on these SNRs. The gating function then utilizes both features and SNRs to optimize expert selection. Unlike conventional MoE models which solely consider the alignment of features with the specializations of experts, our approach additionally considers the impact of channel conditions on expert performance. Experimental results demonstrate that the proposed channel-aware gating scheme outperforms traditional MoE models.

边缘计算MoE信道感知分布式推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。