提出共享层架构与搜索框架,让多任务模型更省电、更快、更小。
ILASH: A Predictive Neural Architecture Search Framework for Multi-Task Applications
- 用层共享思想设计多任务神经网络,减少冗余计算。
- 相比AutoKeras,能耗、碳排放和搜索时间降低最多16倍。
- 适合资源受限设备上部署高效多任务AI模型的开发者。
人工智能广泛应用于医疗、自动驾驶、机器人、交通监控和农业等领域。这些应用多为多任务性质(即对同一数据执行多项分析),且需在资源受限的边缘设备上运行,要求模型在功耗、帧率和体积等指标上均高效。为此,本文提出一种新的神经网络架构(ILASH),通过层共享机制最小化功耗、提升帧率并缩小模型尺寸。同时,提出一种新型神经网络架构搜索框架(ILASH-NAS),用于在给定任务和设备约束下高效构建此类模型。该框架采用数据驱动的智能方法,显著降低搜索过程中的能耗、时间和碳排放。我们在四个开源数据集(UTKFace、MTFL、CelebA、Taskonomy)上进行了大量评估,结果表明,与AutoKeras相比,ILASH-NAS在模型性能和搜索效率方面均有显著提升,最高可减少16倍的能耗、碳排放及训练/搜索时间。
原文摘要 · Abstract (English)
Artificial intelligence (AI) is widely used in various fields including healthcare, autonomous vehicles, robotics, traffic monitoring, and agriculture. Many modern AI applications in these fields are multi-tasking in nature (i.e. perform multiple analysis on same data) and are deployed on resource-constrained edge devices requiring the AI models to be efficient across different metrics such as power, frame rate, and size. For these specific use-cases, in this work, we propose a new paradigm of neural network architecture (ILASH) that leverages a layer sharing concept for minimizing power utilization, increasing frame rate, and reducing model size. Additionally, we propose a novel neural network architecture search framework (ILASH-NAS) for efficient construction of these neural network models for a given set of tasks and device constraints. The proposed NAS framework utilizes a data-driven intelligent approach to make the search efficient in terms of energy, time, and CO2 emission. We perform extensive evaluations of the proposed layer shared architecture paradigm (ILASH) and the ILASH-NAS framework using four open-source datasets (UTKFace, MTFL, CelebA, and Taskonomy). We compare ILASH-NAS with AutoKeras and observe significant improvement in terms of both the generated model performance and neural search efficiency with up to 16x less energy utilization, CO2 emission, and training/search time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。