arXiv:2604.14789cs.AI2026-04被引 1

对比压缩与动态退出在边缘设备上的表现,发现组合使用效果最佳。

A Comparative Study of CNN Optimization Methods for Edge AI: Exploring the Role of Early Exits

  • 用真实硬件对比静态压缩和动态早退方法
  • 早退可按输入自适应节省计算量,优于固定压缩
  • 两者结合能大幅降延迟与内存,精度损失小

在边缘设备上部署深度神经网络需在精度、延迟和资源约束间权衡。现有策略分为两类:静态压缩(如剪枝、量化)永久减小模型尺寸,动态方法(如早退机制)在运行时自适应调整计算开销。尽管两类方法被广泛研究,却很少在真实硬件上进行同等条件比较。本文基于ONNX推理管道,在实际边缘设备上对二者进行统一部署对比。结果表明,静态与动态方法在边缘部署中呈现根本性差异:剪枝与量化可稳定降低内存占用,而早退机制能实现输入自适应的计算节省,这是静态方法无法达到的。两者的结合尤为有效,可在几乎无精度损失下同时降低推理延迟与内存使用,显著拓展了边缘计算的可行性边界。

原文摘要 · Abstract (English)

Deploying deep neural networks on edge devices requires balancing accuracy, latency, and resource constraints under realistic execution conditions. To fit models within these constraints, two broad strategies have emerged: static compression techniques such as pruning and quantization, which permanently reduce model size, and dynamic approaches such as early-exit mechanisms, which adapt computational cost at runtime. While both families are widely studied in isolation, they are rarely compared under identical conditions on physical hardware. This paper presents a unified deployment-oriented comparison of static compression and dynamic early-exit mechanisms, evaluated on real edge devices using ONNX based inference pipelines. Our results show that static and dynamic techniques offer fundamentally different trade-offs for edge deployment. While pruning and quantization deliver consistent memory footprint reduction, early-exit mechanisms enable input-adaptive computation savings that static methods cannot match. Their combination proves highly effective, simultaneously reducing inference latency and memory usage with minimal accuracy loss, expanding what is achievable at the edge.

边缘计算模型压缩早退机制推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。