让机器学习系统自动适应动态环境,降低训练成本。
EMA: Efficient Model Adaptation for Learning-based Systems

- 用状态转换技术让模型快速启动适应新环境。
- 减少14.9%~42.4%的训练时间,提升6.9%~31.3%性能。
- 适合需要长期运行的网络与资源管理系统。
机器学习正被广泛用于优化资源管理与网络仿真等系统性能。与图像分类等传统任务不同,网络系统常处于异构、长期运行且动态变化的环境中,输入条件(如网络负载)和目标会随时间和场景改变。现有学习型系统缺乏自适应能力,导致训练成本高、数据收集量大、性能下降且响应慢。本文提出EMA,首个支持学习型系统在演进环境中低开销自适应的系统。EMA采用系统驱动、数据为中心的方法,兼容多种系统与模型设计,解决两大部署挑战:其一,通过状态变换器将新环境输入对齐至历史相似状态,实现模型暖启动;其二,通过优先标注高价值数据,在训练与标注成本间取得平衡。在八个代表性学习型系统上评估显示,EMA使适应成本(如GPU训练时间)降低14.9%~42.4%,系统性能(如网络吞吐量)提升6.9%~31.3%。
原文摘要 · Abstract (English)
Machine learning (ML) is increasingly applied to optimize system performance in tasks such as resource management and network simulation. Unlike traditional ML tasks (e.g., image classification), networked systems often operate in heterogeneous, long-running, and dynamic environment states, where input conditions (e.g., network loads) and operational objectives can shift over time and across settings. Existing learning-based systems offer little support for adaptation, resulting in costly model training, extensive data collection, degraded system performance, and slow responsiveness. This paper presents EMA, the first model adaptation system supporting learning-based systems to adapt to evolving environments with minimal operational overhead. EMA takes a system-driven, data-centric approach that accommodates diverse system and model designs while addressing two key deployment challenges. First, it reduces expensive model training by introducing state transformers that align the input state of a new environment with previously similar states, allowing models to warm-start adaptation. Second, it addresses the often-overlooked yet costly process of data labeling--collecting ground truth for exploring and training on various system decisions--by prioritizing labeling high-utility data while balancing the tradeoff between training and labeling cost. Evaluations on eight representative learning-based systems show that EMA reduces adaptation costs (e.g., GPU training time) by 14.9-42.4% while improving system performance (e.g., network throughput) by 6.9-31.3%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。