arXiv:2504.09803cs.LG2025-04

将大模型精简为适合边缘设备的小模型,按需保留任务能力。

CUT: Pruning Pre-Trained Multi-Task Models into Compact Models for Edge Devices

  • 按用户需求筛选任务,融合共享参数实现压缩
  • 在保持原模型性能前提下,模型体积显著减小
  • 适合资源受限的边缘设备部署多任务服务

多任务学习因高效利用数据和强泛化能力受到工业界广泛关注,特别适用于为用户提供高质量智能服务。边缘设备作为直接面向用户的主平台,在提供多任务服务中扮演关键角色。然而,现有多任务模型普遍庞大,用户任务需求日益多样,直接部署会加重设备负担并造成任务冗余。为此,本文提出一种专为边缘计算设计的预训练多任务模型剪枝方法,目标是利用已有预训练多任务模型构建适配边缘设备的紧凑模型。具体步骤包括:首先分解模型内任务,并根据实际用户需求选择任务;其次在保留原始预训练知识的前提下,评估参数重要性并采用参数融合方法有效整合任务间的共享参数;最终获得适用于边缘设备的紧凑多任务模型。为验证方法有效性,我们在三个公开图像数据集上进行了实验,结果充分证明了该方法的优越性和效率,为边缘设备上的多任务学习提供了新方案。

原文摘要 · Abstract (English)

Multi-task learning has garnered widespread attention in the industry due to its efficient data utilization and strong generalization capabilities, making it particularly suitable for providing high-quality intelligent services to users. Edge devices, as the primary platforms directly serving users, play a crucial role in delivering multi-task services. However, current multi-task models are often large, and user task demands are increasingly diverse. Deploying such models directly on edge devices not only increases the burden on these devices but also leads to task redundancy. To address this issue, this paper innovatively proposes a pre-trained multi-task model pruning method specifically designed for edge computing. The goal is to utilize existing pre-trained multi-task models to construct a compact multi-task model that meets the needs of edge devices. The specific implementation steps are as follows: First, decompose the tasks within the pre-trained multi-task model and select tasks based on actual user needs. Next, while retaining the knowledge of the original pre-trained model, evaluate parameter importance and use a parameter fusion method to effectively integrate shared parameters among tasks. Finally, obtain a compact multi-task model suitable for edge devices. To validate the effectiveness of the proposed method, we conducted experiments on three public image datasets. The experimental results fully demonstrate the superiority and efficiency of this method, providing a new solution for multi-task learning on edge devices.

模型压缩多任务学习边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。