arXiv:2410.14743cs.LGcs.AI2024-10

无需实际训练即可快速预测模型性能并推荐组件

Efficient Deep Learning Board: Training Feedback Is Not All You Need

  • 构建细粒度系统组件数据集,实现静态性能预测
  • 在CIFAR-10上比顶尖方法快20倍且准确率提升1.31%
  • 兼容主流模型,适合需要快速选型的开发场景

当前自动深度学习(AutoDL)框架依赖实际运行反馈,难以快速准确预测性能。为此,我们提出EfficientDL,一种新型深度学习板,可在无需任何训练反馈的情况下,快速精准推荐27个系统组件并预测模型性能。其核心在于构建了全面、多维、细粒度的系统组件数据集,从而建立静态性能预测模型和综合优化的组件推荐算法(αβ-BO搜索),彻底摆脱传统优化过程中对参数化模型实际运行的依赖。EfficientDL具备强兼容性,可无缝适配主流模型如ResNet50、MobileNetV3、EfficientNet-B0、MaxViT-T、Swin-B和DaViT-T,带来有竞争力的性能提升。在CIFAR-10上的实验表明,EfficientDL在准确率与效率方面均优于现有AutoML工具,相较前沿方法速度提升约20倍,Top-1准确率提高1.31%。源代码、预训练模型及数据集已公开于https://github.com/OpenSELab/EfficientDL。

原文摘要 · Abstract (English)

Current automatic deep learning (i.e., AutoDL) frameworks rely on training feedback from actual runs, which often hinder their ability to provide quick and clear performance predictions for selecting suitable DL systems. To address this issue, we propose EfficientDL, an innovative deep learning board designed for automatic performance prediction and component recommendation. EfficientDL can quickly and precisely recommend twenty-seven system components and predict the performance of DL models without requiring any training feedback. The magic of no training feedback comes from our proposed comprehensive, multi-dimensional, fine-grained system component dataset, which enables us to develop a static performance prediction model and comprehensive optimized component recommendation algorithm (i.e., α\b{eta}-BO search), removing the dependency on actually running parameterized models during the traditional optimization search process. The simplicity and power of EfficientDL stem from its compatibility with most DL models. For example, EfficientDL operates seamlessly with mainstream models such as ResNet50, MobileNetV3, EfficientNet-B0, MaxViT-T, Swin-B, and DaViT-T, bringing competitive performance improvements. Besides, experimental results on the CIFAR-10 dataset reveal that EfficientDL outperforms existing AutoML tools in both accuracy and efficiency (approximately 20 times faster along with 1.31% Top-1 accuracy improvement than the cutting-edge methods). Source code, pretrained models, and datasets are available at https://github.com/OpenSELab/EfficientDL.

AutoDL性能预测组件推荐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。