arXiv:2512.12816cs.LGcs.NI2025-12

在概念漂移下,如何用有限预算高效分配模型训练与部署资源。

Optimal Resource Allocation for ML Model Training and Deployment under Concept Drift

  • 提出无模型依赖框架,统一建模资源分配与概念漂移关系。
  • 证明在突发漂移下,DMRL分布的最优训练策略可实现性能上限。
  • 设计随机调度策略,在通信受限时逼近最优客户端性能。

我们研究在概念漂移和预算受限条件下,机器学习模型训练与部署的资源分配问题。模型提供方将训练好的模型分发给多个客户端,客户端仅支持本地推理但无法重训练,因此性能维护责任落在提供方。本文提出一个无模型依赖框架,捕捉资源分配、概念漂移动态与部署时机之间的交互关系。我们证明,最优训练策略高度依赖概念持续时间的衰减特性。在突发概念变化场景下,当概念持续时间服从递减均值残余寿命(DMRL)分布时,可在预算约束下推导出最优训练策略;而对递增均值残余寿命(IMRL)分布,直观启发式方法被证明是严格次优的。此外,在通信受限条件下研究模型部署,证明相关优化问题在温和条件下为拟凸,提出一种随机调度策略,可实现接近最优的客户端性能。这些结果为概念漂移下的成本高效模型管理提供了理论与算法基础,对持续学习、分布式推理与自适应机器学习系统具有重要意义。

原文摘要 · Abstract (English)

We study how to allocate resources for training and deployment of machine learning (ML) models under concept drift and limited budgets. We consider a setting in which a model provider distributes trained models to multiple clients whose devices support local inference but lack the ability to retrain those models, placing the burden of performance maintenance on the provider. We introduce a model-agnostic framework that captures the interaction between resource allocation, concept drift dynamics, and deployment timing. We show that optimal training policies depend critically on the aging properties of concept durations. Under sudden concept changes, we derive optimal training policies subject to budget constraints when concept durations follow distributions with Decreasing Mean Residual Life (DMRL), and show that intuitive heuristics are provably suboptimal under Increasing Mean Residual Life (IMRL). We further study model deployment under communication constraints, prove that the associated optimization problem is quasi-convex under mild conditions, and propose a randomized scheduling strategy that achieves near-optimal client-side performance. These results offer theoretical and algorithmic foundations for cost-efficient ML model management under concept drift, with implications for continual learning, distributed inference, and adaptive ML systems.

概念漂移资源分配持续学习分布式推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。