arXiv:2510.16716cs.CRcs.LG2025-10

用可信执行环境保护大模型,实现边缘设备安全微调。

DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edge

  • 在可信环境运行大模型作为密钥教师,防止模型泄露。
  • 通过权重混淆技术,边端高效完成知识蒸馏且不暴露模型。
  • 兼顾隐私与安全,适合需要本地化个性化的大模型应用。

大型语言模型(LLMs)在多种任务中表现出色,但通常依赖云上集中式基础设施进行微调,需将敏感数据上传至外部服务器,引发严重隐私担忧。另一种方案是在边缘设备上使用本地数据直接微调模型,但这带来新挑战:模型所有者需将专有模型传输至边缘设备,存在知识产权(IP)泄露风险。为此,我们提出 DistilLock,一种基于可信执行环境(TEE)的边缘微调框架,支持隐私保护的知识蒸馏。在 DistilLock 中,专有基础模型在数据所有者设备的 TEE 隐私区域中运行,作为安全黑盒教师,有效防止对模型内部的直接访问,同时保障数据隐私与模型知识产权。此外,DistilLock 采用模型混淆机制,将混淆后的权重传至不可信加速器,实现高效知识蒸馏且不牺牲安全性。实验表明,DistilLock 能有效防范未经授权的知识蒸馏和模型盗取攻击,同时保持高计算效率,为边缘 LLM 个性化提供安全且实用的解决方案。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated strong performance across diverse tasks, but fine-tuning them typically relies on cloud-based, centralized infrastructures. This requires data owners to upload potentially sensitive data to external servers, raising serious privacy concerns. An alternative approach is to fine-tune LLMs directly on edge devices using local data; however, this introduces a new challenge: the model owner must transfer proprietary models to the edge, which risks intellectual property (IP) leakage. To address this dilemma, we propose DistilLock, a TEE-assisted fine-tuning framework that enables privacy-preserving knowledge distillation on the edge. In DistilLock, a proprietary foundation model is executed within a trusted execution environment (TEE) enclave on the data owner's device, acting as a secure black-box teacher. This setup preserves both data privacy and model IP by preventing direct access to model internals. Furthermore, DistilLock employs a model obfuscation mechanism to offload obfuscated weights to untrusted accelerators for efficient knowledge distillation without compromising security. We demonstrate that DistilLock prevents unauthorized knowledge distillation processes and model-stealing attacks while maintaining high computational efficiency, but offering a secure and practical solution for edge-based LLM personalization.

大模型安全边缘计算知识蒸馏可信执行

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。