arXiv:2504.03686cs.NIcs.AI2025-04被引 18

提出推理中断概率,精准评估边缘推理系统可靠性。

Revisiting Outage for Edge Inference Systems

  • 引入推理中断概率,量化端到端推理精度低于阈值的概率。
  • 在延迟约束下,揭示通信开销与推理可靠性的根本权衡关系。
  • 适合关注边缘AI系统可靠性设计的工程师和研究人员。

第六代移动网络(6G)的核心目标之一是将大规模人工智能模型部署于网络边缘,为边缘设备提供远程推理服务。这一平台支持自动驾驶、工业自动化和增强现实等物联网应用。由于这些任务具有关键性和实时性,必须设计既可靠又满足严格端到端(E2E)延迟约束的边缘推理系统。现有研究主要关注以信道中断概率表征的通信可靠性,可能无法保障端到端性能,尤其在推理准确率和延迟方面。为此,本文提出一个理论框架,引入并数学刻画了推理中断(InfOut)概率,用于量化端到端推理精度低于目标阈值的可能性。在端到端延迟约束下,该框架建立了通信开销(即上传更多传感器观测)与推理可靠性(以InfOut概率衡量)之间的基本权衡。为实现可计算优化,通过高斯近似接收判别增益分布,推导出精确的代理函数。实验结果表明,所提设计在端到端推理可靠性方面优于传统的以通信为中心的方法。

原文摘要 · Abstract (English)

One of the key missions of sixth-generation (6G) mobile networks is to deploy large-scale artificial intelligence (AI) models at the network edge to provide remote-inference services for edge devices. The resultant platform, known as edge inference, will support a wide range of Internet-of-Things applications, such as autonomous driving, industrial automation, and augmented reality. Given the mission-critical and time-sensitive nature of these tasks, it is essential to design edge inference systems that are both reliable and capable of meeting stringent end-to-end (E2E) latency constraints. Existing studies, which primarily focus on communication reliability as characterized by channel outage probability, may fail to guarantee E2E performance, specifically in terms of E2E inference accuracy and latency. To address this limitation, we propose a theoretical framework that introduces and mathematically characterizes the inference outage (InfOut) probability, which quantifies the likelihood that the E2E inference accuracy falls below a target threshold. Under an E2E latency constraint, this framework establishes a fundamental tradeoff between communication overhead (i.e., uploading more sensor observations) and inference reliability as quantified by the InfOut probability. To find a tractable way to optimize this tradeoff, we derive accurate surrogate functions for InfOut probability by applying a Gaussian approximation to the distribution of the received discriminant gain. Experimental results demonstrate the superiority of the proposed design over conventional communication-centric approaches in terms of E2E inference reliability.

边缘推理6G可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。