arXiv:2506.09066cs.CVcs.AI2025-06

让AI模型在物联网设备上灵活适配,按需拼接不同大小模型。

ReStNet: A Reusable & Stitchable Network for Dynamic Adaptation on IoT Devices

  • 通过计算层相似性动态拼接两个预训练模型,实现模型灵活组合。
  • 仅微调拼接层即可适配不同资源条件,训练成本大幅降低。
  • 支持同构与异构模型拼接,适合边缘计算场景快速部署。

随着深度学习快速发展,大量预训练模型公开可用。然而,在真实物联网应用中部署这些固定模型面临挑战,因设备计算与内存资源异构,难以统一部署。传统压缩方法如剪枝、量化和知识蒸馏虽可提升效率,但一旦应用便缺乏灵活性,无法适应资源变化。为此,本文提出 ReStNet:一种可复用且可拼接的网络,通过动态拼接两个预训练模型构建混合模型。其核心挑战包括选择最优拼接点、确定模型拼接顺序及有效微调策略。ReStNet利用中心核对齐(CKA)计算层间相似性,选取最佳拼接位置,保留大模型前层并连接小模型深层,仅微调拼接层以实现高效部署。该设计支持同构(CNN-CNN、Transformer-Transformer)与异构(CNN-Transformer)拼接,灵活融合不同模型架构。多基准测试表明,ReStNet可在运行时实现灵活的精度-效率权衡,显著降低训练成本。

原文摘要 · Abstract (English)

With the rapid development of deep learning, a growing number of pre-trained models have been publicly available. However, deploying these fixed models in real-world IoT applications is challenging because different devices possess heterogeneous computational and memory resources, making it impossible to deploy a single model across all platforms. Although traditional compression methods, such as pruning, quantization, and knowledge distillation, can improve efficiency, they become inflexible once applied and cannot adapt to changing resource constraints. To address these issues, we propose ReStNet, a Reusable and Stitchable Network that dynamically constructs a hybrid network by stitching two pre-trained models together. Implementing ReStNet requires addressing several key challenges, including how to select the optimal stitching points, determine the stitching order of the two pre-trained models, and choose an effective fine-tuning strategy. To systematically address these challenges and adapt to varying resource constraints, ReStNet determines the stitching point by calculating layer-wise similarity via Centered Kernel Alignment (CKA). It then constructs the hybrid model by retaining early layers from a larger-capacity model and appending deeper layers from a smaller one. To facilitate efficient deployment, only the stitching layer is fine-tuned. This design enables rapid adaptation to changing budgets while fully leveraging available resources. Moreover, ReStNet supports both homogeneous (CNN-CNN, Transformer-Transformer) and heterogeneous (CNN-Transformer) stitching, allowing to combine different model families flexibly. Extensive experiments on multiple benchmarks demonstrate that ReStNet achieve flexible accuracy-efficiency trade-offs at runtime while significantly reducing training cost.

模型拼接边缘计算动态适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。