边端设备动态调整训练与推理资源,让热门任务提前优化。
DART-FL: Burst-Aware Multitask Federated Learning under Dynamic Inference Demand at the Edge

- 根据推理积压量动态分配训练资源,优先保障高频任务。
- 高请求任务在突发期获得更强训练权重,准确率提升12%以上。
- 适合边缘智能中多任务并发、需求波动的场景使用。
边缘智能系统需在资源受限设备上同时支持模型训练与在线推理,而不同任务的推理需求随时间波动显著。这带来双重挑战:必须为推理预留足够算力以满足服务等级目标(SLO),同时剩余训练能力应随任务需求变化,使高频任务在训练早期即可加速优化。本文提出DART-FL——一种兼顾SLO、响应动态推理需求的多任务联邦学习框架。每调度周期内,DART-FL基于推理积压和已知服务容量,确定推理所需最小资源;剩余训练资源通过受队列启发的DPP调度器分配,并映射为动态损失权重,使高需求任务在早期通信轮次获得更多训练关注。客户端共享骨干网络并拥有任务特定头,完整多任务模型通过FedAvg聚合。在Stanford Cars与Oxford Flowers 102数据集上,采用合成及阿里真实追踪工作负载进行评估。结果表明,DART-FL能动态调节推理-训练资源比例,将高需求任务的学习进度推向其请求高峰时段,在频繁调用时提升准确率超12%,同时保持长期多任务性能稳定。
原文摘要 · Abstract (English)
Edge intelligence systems increasingly require model training and online inference to coexist on resource-constrained devices, while inference demand can vary substantially across tasks over time. This creates two coupled challenges: sufficient computation must be reserved for inference to maintain service-level objectives (SLOs), while the remaining training capacity should adapt to task-specific demand so that frequently requested tasks can improve earlier during training. We propose an SLO-aware, demand-driven multitask federated learning framework (DART-FL) that jointly adapts the inference-training resource split and task-level training emphasis. At each scheduling interval, DART-FL uses the inference backlog and profiled service capacity to determine the minimum resource allocation required for inference. The remaining training capacity is then distributed across tasks using a queue-aware DPP-inspired scheduler, and the resulting task allocations are mapped to dynamic loss weights. This allows tasks experiencing higher inference demand to receive greater training emphasis in earlier communication rounds. Clients train a shared backbone with task-specific heads, and the complete multitask model is aggregated through FedAvg. We evaluate DART-FL using Stanford Cars and Oxford Flowers 102 under both synthetic and real Alibaba trace-derived workloads. Results show that DART-FL dynamically adapts the inference-training resource split to time-varying inference demand and shifts the learning progress of high-demand tasks toward their burst periods, improving model accuracy when those tasks are frequently requested while maintaining comparable long-term multitask performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。