arXiv:2508.08985cs.LG2025-08

提出低复杂度高效率的分层推理学习方法,解决边缘设备推理决策难题。

Low-Regret and Low-Complexity Learning for Hierarchical Inference

  • 用置信度构建本地模型正确率函数,结合上界置信算法优化决策
  • 实现$O(\log T)$最优后悔值,比现有方法快得多,且每样本计算复杂度$O(1)$
  • 适合资源受限设备部署,实测优于当前最先进方法

本工作聚焦边缘智能系统中的分层推理(HI),即终端设备上的轻量级本地模型与边缘服务器上的高精度远程模型协同工作。通过先用本地模型推理,仅在可能错误时才卸载至远程模型,以降低延迟、提升准确率并减少带宽消耗。其核心挑战在于动态估计本地推理出错概率,尤其当数据分布和卸载成本随时间变化时——这一问题称为分层推理学习(HIL)。本文提出一种新方法,将本地模型推理正确概率建模为置信度的递增函数,基于实证观察但此前未被利用。设计两种策略:HI-LCB与HI-LCB-lite,均基于上界置信(UCB)框架。证明两者均达到$O(\log T)$的阶最优后悔率,显著优于现有方法的$O(T^{2/3})$。值得注意的是,HI-LCB-lite每样本计算复杂度为$O(1)$,极适合资源受限设备部署。使用真实数据集的仿真验证表明,该策略性能超越现有最先进方案。

原文摘要 · Abstract (English)

This work focuses on Hierarchical Inference (HI) in edge intelligence systems, where a compact Local-ML model on an end-device works in conjunction with a high-accuracy Remote-ML model on an edge-server. HI aims to reduce latency, improve accuracy, and lower bandwidth usage by first using the Local-ML model for inference and offloading to the Remote-ML only when the local inference is likely incorrect. A critical challenge in HI is estimating the likelihood of the local inference being incorrect, especially when data distributions and offloading costs change over time -- a problem we term Hierarchical Inference Learning (HIL). We introduce a novel approach to HIL by modeling the probability of correct inference by the Local-ML as an increasing function of the model's confidence measure, a structure motivated by empirical observations but previously unexploited. We propose two policies, HI-LCB and HI-LCB-lite, based on the Upper Confidence Bound (UCB) framework. We demonstrate that both policies achieve order-optimal regret of $O(\log T)$, a significant improvement over existing HIL policies with $O(T^{2/3})$ regret guarantees. Notably, HI-LCB-lite has an $O(1)$ per-sample computational complexity, making it well-suited for deployment on devices with severe resource limitations. Simulations using real-world datasets confirm that our policies outperform existing state-of-the-art HIL methods.

边缘计算分层推理在线学习低复杂度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。