轻量级方法让边缘计算模型自动适应用户差异,提升隐私保护下的推理准确率。
Lightweight User-Personalization Method for Closed Split Computing
- 在不改动原模型的前提下,用小适配器优化中间特征以实现个性化。
- 在CIFAR-10上将个人化准确率从88.1%提升至93.8%,训练延迟降低60%以上。
- 适合需要低通信开销、高隐私性与强鲁棒性的边缘部署场景。
Split Computing通过将深度神经网络分割为边缘端头部和云端尾部,在降低延迟的同时限制原始数据暴露。然而,实际部署中因用户数据分布偏移、通信不可靠及隐私扰动导致性能下降,尤其在模型架构与参数不可访问的封闭环境中。为此,我们提出SALT(Split-Adaptive Lightweight Tuning)——一种轻量级适配框架。SALT引入紧凑的客户端适配器,对冻结头部网络输出的中间表示进行微调,实现有效适应,无需修改头尾网络或增加通信开销。仅通过调整训练条件,即可支持用户个性化、通信鲁棒性和隐私感知推理。在ResNet-18与CIFAR-10/100上的实验表明,SALT在保持低训练成本的同时,优于传统重训练与微调方法。在CIFAR-10上,个性化准确率由88.1%提升至93.8%,训练延迟减少超60%。在75%丢包率下仍保持超90%准确率,噪声注入(sigma=1.0)下准确率约88%。结果证明SALT是真实世界分裂计算系统的高效实用适配方案。
原文摘要 · Abstract (English)
Split Computing enables collaborative inference between edge devices and the cloud by partitioning a deep neural network into an edge-side head and a server-side tail, reducing latency and limiting exposure of raw input data. However, inference performance often degrades in practical deployments due to user-specific data distribution shifts, unreliable communication, and privacy-oriented perturbations, especially in closed environments where model architectures and parameters are inaccessible. To address this challenge, we propose SALT (Split-Adaptive Lightweight Tuning), a lightweight adaptation framework for closed Split Computing systems. SALT introduces a compact client-side adapter that refines intermediate representations produced by a frozen head network, enabling effective model adaptation without modifying the head or tail networks or increasing communication overhead. By modifying only the training conditions, SALT supports multiple adaptation objectives, including user personalization, communication robustness, and privacy-aware inference. Experiments using ResNet-18 on CIFAR-10 and CIFAR-100 show that SALT achieves higher accuracy than conventional retraining and fine-tuning while significantly reducing training cost. On CIFAR-10, SALT improves personalized accuracy from 88.1% to 93.8% while reducing training latency by more than 60%. SALT also maintains over 90% accuracy under 75% packet loss and preserves high accuracy (about 88% at sigma = 1.0) under noise injection. These results demonstrate that SALT provides an efficient and practical adaptation framework for real-world Split Computing systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。