arXiv:2501.13810cs.LGcs.AI2025-01ICLR被引 2

让边缘设备在资源有限时,智能选择何时求助云端完成多分类任务。

Learning to Help in Multi-Class Settings

  • 设计可微分的分阶段损失函数,实现多分类场景下的智能求助决策。
  • 在多个实际场景中验证,相比全本地或全云端模型,节省超60%服务器调用。
  • 适合边缘计算、移动设备等算力受限但需高精度分类的应用场景。

在计算资源受限的设备上部署复杂机器学习模型面临挑战,主要受限于算力、内存和模型可重训练性。为缓解此问题,可通过在本地模型基础上引入服务端模型构建混合系统:由客户端的拒绝器决定何时将样本发送至服务端处理。该混合系统能高效利用计算资源并减少服务端使用开销。近期提出的Learning to Help(L2H)模型在固定本地模型的前提下训练服务端模型,与Learning to Defer(L2D)框架不同,后者是在固定专家服务端模型下训练客户端。两者均包含客户端学习拒绝策略以决定是否请求服务端协助。本文将L2H模型从二分类扩展至多分类任务,并在多种实际应用场景中验证其有效性,这些场景中服务端访问受成本、可用性或政策限制。我们推导出一种可微分、凸且与0-1损失贝叶斯规则一致的阶段切换代理损失函数。实验表明,所提方法在资源受限环境下提供了高效且实用的多分类解决方案。

原文摘要 · Abstract (English)

Deploying complex machine learning models on resource-constrained devices is challenging due to limited computational power, memory, and model retrainability. To address these limitations, a hybrid system can be established by augmenting the local model with a server-side model, where samples are selectively deferred by a rejector and then sent to the server for processing. The hybrid system enables efficient use of computational resources while minimizing the overhead associated with server usage. The recently proposed Learning to Help (L2H) model trains a server model given a fixed local (client) model, differing from the Learning to Defer (L2D) framework, which trains the client for a fixed (expert) server. In both L2D and L2H, the training includes learning a rejector at the client to determine when to query the server. In this work, we extend the L2H model from binary to multi-class classification problems and demonstrate its applicability in a number of different scenarios of practical interest in which access to the server may be limited by cost, availability, or policy. We derive a stage-switching surrogate loss function that is differentiable, convex, and consistent with the Bayes rule corresponding to the 0-1 loss for the L2H model. Experiments show that our proposed methods offer an efficient and practical solution for multi-class classification in resource-constrained environments.

边缘计算多分类智能决策混合推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。