让神经网络搜索直接适配低精度部署,提升边缘AI模型落地准确性。
Deployment-Aligned Low-Precision Neural Architecture Search for Spaceborne Edge AI

- 在搜索阶段就引入低精度训练,让模型在真实部署环境优化。
- 同一模型在低精度下准确率从0.78提升至0.826 mIoU。
- 适合对边缘设备性能和精度要求高的航天遥感等场景。
在边缘加速器上设计满足严格延迟与精度约束的深度网络,越来越依赖硬件感知优化,包括基于设备级指标的神经架构搜索(NAS)。然而,大多数硬件感知的NAS流程仍在全精度假设下优化架构,仅在搜索完成后进行低精度适配,导致优化阶段行为与低精度硬件部署阶段不匹配,显著降低准确率。本文通过将部署一致的低精度训练直接集成到硬件感知的NAS中,解决这一问题。候选架构在微调和评估阶段均受FP16数值约束,实现架构效率与数值鲁棒性的联合优化,无需修改搜索空间或进化策略。我们在面向星载海事监控的船舶分割任务上评估该框架,目标设备为Intel Movidius Myriad X VPU。相较于后训练精度转换导致的准确率从0.85降至0.78 mIoU,部署对齐的低精度训练使同一架构(95,791参数)在设备端达到0.826 mIoU,恢复了约三分之二的部署损失,且未增加模型复杂度。结果表明,在硬件感知的NAS中融入部署一致的数值约束,可显著提升资源受限边缘AI的鲁棒性与优化-部署一致性。
原文摘要 · Abstract (English)
Designing deep networks that meet strict latency and accuracy constraints on edge accelerators increasingly relies on hardware-aware optimization, including neural architecture search (NAS) guided by device-level metrics. Yet most hardware-aware NAS pipelines still optimize architectures under full-precision assumptions and apply low-precision adaptation only after the search, leading to a mismatch between optimization-time behavior and deployment-time execution on low-precision hardware that can substantially degrade accuracy. We address this limitation by integrating deployment-aligned low-precision training directly into hardware-aware NAS. Candidate architectures are exposed to FP16 numerical constraints during fine-tuning and evaluation, enabling joint optimization of architectural efficiency and numerical robustness without modifying the search space or evolutionary strategy. We evaluate the proposed framework on vessel segmentation for spaceborne maritime monitoring, targeting the Intel Movidius Myriad X Visual Processing Unit (VPU). While post-training precision conversion reduces on-device performance from 0.85 to 0.78 mIoU, deployment-aligned low-precision training achieves 0.826 mIoU on-device for the same architecture (95,791 parameters), recovering approximately two-thirds of deployment-induced accuracy gap without increasing model complexity. These results demonstrate that incorporating deployment-consistent numerical constraints into hardware-aware NAS substantially improves robustness and alignment between optimization and deployment for resource-constrained edge Artificial Intelligence (AI).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。