arXiv:2604.26470cs.LG2026-04中稿 · 5th Real-time And …

边缘设备动态推理的分层自适应控制,兼顾低延迟与高能效。

Hierarchical adaptive control for real-time dynamic inference at the edge

论文配图:Hierarchical adaptive control for real-time dynamic inference at the edge
图 1 · 摘自论文原文
  • 分两级控制:全局调度部署轻量级分类器级联,本地控制器实时调整
  • 实测推理延迟降低2.45倍,能耗减少2.86倍,精度损失小于4%
  • 适合资源受限的工业边缘场景,尤其数据漂移频繁的部署

工业系统日益依赖机器学习,运行在异构边缘节点上,需满足严格的延迟、能耗和内存约束。动态模型可在运行时重构计算开销,以小幅精度损失换取高能效和更低平均延迟,但部署复杂,因依赖额外超参数。这些超参数通常在与测试分布匹配的校准数据集上调优,而现实场景中该假设极少成立,导致性能低于静态模型。本文提出两级自适应架构,协同优化模型与系统决策:全局调度器为每个边缘节点配置由轻量专用模型与通用回退组成的级联结构,满足延迟与内存限制;节点级控制器跟踪数据漂移与硬件资源,按需启用或禁用专用预测器(SP),维持高能效并避免延迟越界。该设计支持长时间运行且无需全局重部署,即使远程全局控制器不可达也能高效执行。在两个数据集的受控分布偏移场景下评估,相比静态基线,平均每次推理延迟降低最高达2.45倍,能耗降低最高达2.86倍,精度下降不足4%。贡献包括:(1) 保留最坏情况延迟约束的预算化SP级联建模;(2) 在数据与资源变化下保持效率的分层控制器;(3) 在嵌入式硬件上的实验验证。

原文摘要 · Abstract (English)

Industrial systems increasingly depend on Machine Learning (ML), and operate on heterogeneous nodes that must satisfy tight latency, energy, and memory constraints. Dynamic ML models, which reconfigure their computational footprint at runtime, promise high energy efficiency and lower average latency for modest accuracy tradeoffs; however, their deployment is complex due to the additional hyperparameters they rely on. These hyperparameters, controlling the accuracy versus average latency tradeoff, are often tuned on a calibration dataset that must match the test time distribution, an assumption that rarely holds in real-world scenarios, leading to suboptimal operational conditions, possibly below static models. We propose a two-tier adaptive architecture that co-optimizes model and system decisions. At the global level, a scheduler configures and deploys, for each edge node, a cascade of classifiers composed of lightweight specialized models and a generalist fallback, satisfying latency and memory constraints. At the node level, a local controller tracks data drifts and hardware resources, enabling or disabling specialized predictors (SP) to preserve high energy efficiency and avoid latency-constraint violations under varying conditions. This design allows longer operating times without forcing a global redeployment step, and enables efficient execution in case of an unreachable remote global controller. We evaluate the approach on two datasets under controlled distribution mismatch scenarios, showing average per-inference reductions of latency up to 2.45x and energy up to 2.86x, with less than 4% accuracy drop compared to static baselines. Our contributions are:(1) a budgeted SP-cascade formulation that preserves worst-case latency constraints;(2) a hierarchical controller that maintains efficiency under data and resource changes; and (3) an experimental evaluation on embedded hardware.

边缘计算动态推理自适应控制能效优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。