为边缘推理中的信道退化问题提供理论分析与优化方法
A PAC-Bayesian Analysis of Channel-Induced Degradation in Edge Inference
- 引入带信道统计的增强神经网络模型,融合无线特性到权重空间
- 基于PAC-Bayesian框架,给出性能退化的高概率上界
- 提出感知信道的训练算法,提升多种信道下的推理鲁棒性
在边缘学习范式中,神经网络被分布部署于多个边缘设备,通过无线传输协同完成推理。然而,在训练阶段未知真实信道实现的情况下,无线信道会导致推理性能下降。本文建立理论框架,评估并界定此性能退化。受统计学习理论启发,定义无线泛化误差以刻画训练时的实证性能与真实随机信道下期望推理性能之间的差距。为支持理论分析,引入一种将信道统计直接融入权重空间的增强神经网络模型。利用PAC-Bayesian框架,推导出该误差的高概率上界,为无线推理性能提供理论保证。进一步提出一种信道感知训练算法,通过最小化基于该上界的可计算代理目标来优化模型。仿真表明,所提算法能有效提升不同信道条件下的推理性能与模型鲁棒性。
原文摘要 · Abstract (English)
In the emerging paradigm of edge learning, neural networks (NNs) are partitioned across distributed edge devices that collaboratively perform inference via wireless transmission. However, deploying NNs for edge inference over wireless channels inevitably leads to performance degradation, as the exact channel realizations in the inference stage are not known in the training stage. In this paper, we establish a theoretical framework to evaluate and bound this performance degradation. Inspired by statistical learning theory, we define a wireless generalization error to characterize the gap between the empirical performance during training and the expected inference performance under the true stochastic channel. To enable theoretical analysis, we introduce an augmented NN model that incorporates channel statistics directly into the weight space. Leveraging the PAC-Bayesian framework, we derive a high-probability bound on this error, which provides theoretical guarantees for wireless inference performance. Furthermore, we propose a channel-aware training algorithm that minimizes a tractable surrogate objective based on the derived bound. Simulations demonstrate that the proposed algorithm effectively improves wireless inference performance and model robustness under various channel conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。