arXiv:2604.14661cs.SEcs.AI2026-04

用AI代理自动部署模型,提速降门槛。

AIPC: Agent-Based Automation for AI Model Deployment with Qualcomm AI Runtime

  • 设计可拆解的标准化部署流程,注入领域知识辅助决策。
  • 复杂模型部署可在7-20分钟内完成,成本约0.7-10美元。
  • 适合需要快速适配高通AI推理引擎的工程师使用。

边缘AI模型部署是一个多阶段工程过程,包括模型转换、算子兼容性处理、量化校准、运行时集成和精度验证。实际中该流程耗时长、易出错,且高度依赖部署经验,尤其在针对硬件特定推理运行时的情况下。本技术报告提出AIPC(AI Porting Conversion),一种基于AI代理的受限自动化方法,用于实现AI模型部署的自动化。AIPC将部署过程分解为标准化、可验证的阶段,并通过代理技能、辅助脚本和分阶段验证循环注入领域知识,降低对专家经验的依赖并缩短工程时间。以高通AI运行时(QAIRT)为主要场景,报告考察了代表性视觉、多模态和语音模型的自动化部署。在所覆盖案例中,从PyTorch到可运行的QNN/SNPE推理模型的部署可在7-20分钟内完成,对应API成本约为0.7-10美元。对于包含低支持算子、动态形状或自回归解码结构的复杂模型,完全自动化仍需进一步研究,但AIPC已能提供执行支持、故障定位与可控修复能力。

原文摘要 · Abstract (English)

Edge AI model deployment is a multi-stage engineering process involving model conversion, operator compatibility handling, quantization calibration, runtime integration, and accuracy validation. In practice, this workflow is long, failure-prone, and heavily dependent on deployment expertise, particularly when targeting hardware-specific inference runtimes. This technical report presents AIPC (AI Porting Conversion), an AI agent-driven approach for constrained automation of AI model deployment. AIPC decomposes deployment into standardized, verifiable stages and injects deployment-domain knowledge into agent execution through Agent Skills, helper scripts, and a stage-wise validation loop. This design reduces both the expertise barrier and the engineering time required for hardware deployment. Using Qualcomm AI Runtime (QAIRT) as the primary scenario, this report examines automated deployment across representative vision, multimodal, and speech models. In the cases covered here, AIPC can complete deployment from PyTorch to runnable QNN/SNPE inference within 7-20 minutes for structurally regular vision models, with indicative API costs roughly in the range of USD 0.7-10. For more complex models involving less-supported operators, dynamic shapes, or autoregressive decoding structures, fully automated deployment may still require further advances, but AIPC already provides practical support for execution, failure localization, and bounded repair.

模型部署AI代理高通AI自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。