让操作系统为机器学习优化,提升云上模型运行效率。
MaLV-OS: Rethinking the Operating System Architecture for Machine Learning in Virtualized Clouds
- 用微内核+ML服务子系统重构系统架构,专为机器学习设计。
- 将模型敏感部分卸载到系统层,降低模型复杂度并加速执行。
- 支持虚拟机动态选择优化策略,可灵活扩展新功能。
现有研究多用机器学习优化操作系统决策,但很少有工作反过来利用操作系统提升机器学习性能。本文提出一种面向机器学习的新型操作系统架构——MaLV-OS,专为虚拟化云环境中的机器学习工作负载设计。其核心包括一个允许内核程序使用GPU的微内核Micro-LAKE,以及一个提供内存管理与CPU调度支持的MLaaS(机器学习即服务)子系统。通过将模型中对系统敏感的部分移至操作系统层面,减轻模型负担,加快执行速度。同时,MaLV-OS集成开源GPU虚拟化软件并直接嵌入虚拟机监控器。系统支持虚拟机动态选择MLaaS策略以适配当前运行模型,且因MLaaS采用可加载模块设计,可实现功能动态扩展。
原文摘要 · Abstract (English)
A large body of research has employed Machine Learning (ML) models to develop learned operating systems (OSes) and kernels. The latter dynamically adapts to the job load and dynamically adjusts resources (CPU, IO, memory, network bandwidth) allocation to respond to the actual user demand. What this work has in common is that it utilizes ML to improve kernel decisions. To this day, and to the best of our knowledge, no work has taken the opposite direction, i.e., using OS to improve ML. While some work proposes applying system-level optimizations to ML algorithms, they do not tailor the OS to adapt to the ML context. To address this limitation, we take an orthogonal approach in this paper by leveraging the OS to enhance the performance of ML models and algorithms. We explore the path towards an ML-specialized OS, MaLV-OS. MaLV-OS rethinks the OS architecture to make it specifically tailored to ML workloads, especially in virtualized clouds, which are now widely used to run ML applications. MaLV-OS envisioned architecture includes (1) a micro-kernel, Micro-LAKE, which allows kernel space applications to use the GPU, and (2) an MLaaS (ML as a Service) subsystem that gathers ML models to help Micro-LAKE with memory management and CPU scheduling. MaLV-OS architecture also offloads system-sensitive parts of the models to the OS, to lighten the model complexity and programming, and speed up its execution. Finally, MaLV-OS integrates an open-source GPU virtualization software, merged directly into the hypervisor. For more flexibility, MaLV-OS vision is to enable the virtual machine to dynamically select MLaaS policies that can improve the performance of the model the user is running. Because MLaaS is designed as loadable kernel modules, the MaLV-OS architecture enables the dynamic addition of new capabilities to the MLaaS subsystem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。