arXiv:2511.22355cs.LG2025-11

AutoTailor自动适配边缘设备,一键生成高效神经网络。

AutoTailor: Automatic and Efficient Adaptive Model Deployment for Diverse Edge Devices

  • 用计算图引导编译自动构建SuperNet,免去手动设计
  • 无需训练即可预测延迟和精度,大幅降低部署成本
  • 适合需要快速适配多种边缘设备的开发者

在设备端机器学习已成为新兴移动应用的核心组成部分。自适应模型部署通过定制神经网络架构,实现对异构设备能力和性能需求的高效推理。基于SuperNet的方法可通过预训练模型生成大量模型变体,是极具前景的解决方案。然而,现有框架中应用SuperNet需繁琐的模型感知开发和耗时的硬件感知性能评估,限制了其实际应用。本文提出AutoTailor,首个支持边缘设备上端到端SuperNet自适应部署的自动化框架。不同于手动构建SuperNet,AutoTailor采用计算图引导的编译方法,可自动将用户提供的ML模型转换为SuperNet。为支持高效定制,AutoTailor引入无学习的延迟与精度预测器,实现低成本且高精度的性能预估。扩展评估表明,AutoTailor将SuperNet构建代码量减少11--27倍,硬件感知调优成本降低至少11倍,并在多种模型与设备上实现最高15.60%的准确率提升和60.03%的延迟降低,优于当前最优方法。

原文摘要 · Abstract (English)

On-device machine learning (ML) has become a fundamental component of emerging mobile applications. Adaptive model deployment delivers efficient inference for heterogeneous device capabilities and performance requirements through customizing neural architectures. SuperNet-based approaches offer a promising solution by generating a large number of model variants from a pre-trained ML model. However, applying SuperNet in existing frameworks suffers from tedious model-aware development and time-consuming hardware-aware profiling, which limits their practical adoption. We present AutoTailor, the first framework to enable automated, end-to-end SuperNet-based adaptive model deployment for edge devices. Unlike manual SuperNet construction, AutoTailor employs a computation graph-guided compilation approach to automatically transform user-provided ML models into SuperNets. To support efficient specialization, AutoTailor incorporates learning-free latency and accuracy predictors, enabling low-cost yet accurate performance prediction. Our extended evaluations demonstrate that AutoTailor reduces the lines of code for SuperNet construction by 11--27$\times$, decreases hardware-aware profiling costs by at least 11$\times$, and achieves up to 15.60\% absolute accuracy improvement and 60.03\% latency reduction compared to state-of-the-art approaches across diverse models and devices.

边缘计算模型部署SuperNet自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。