为边缘设备设计的精准数据删除系统,兼顾隐私与资源限制。
Edge Unlearning is Not "on Edge"! An Adaptive Exact Unlearning System on Resource-Constrained Devices
- 通过斐波那契替换策略和自适应分片,减少重训练开销。
- 在资源受限设备上实现精准删除,速度提升最多80.86%。
- 适合物联网、移动设备等低算力场景下的隐私保护需求。
被遗忘权要求机器学习模型能够删除数据所有者的数据信息。仅从数据集移除数据不足以消除风险,因模型可能记忆训练数据。现有近似删除方法效果不可靠,而精确删除需重训练,成本过高。针对边缘设备、物联网、移动设备等资源受限场景,本文提出CAUSE:一种面向网络边缘的约束感知自适应精确删除系统。通过在设备端存储子模型,结合斐波那契替换策略与用户级数据分区的自适应分片机制,降低重训练开销。进一步利用模型剪枝压缩内存,几乎不牺牲精度。实验表明,相比其他系统,CAUSE在资源受限设备上的未学习速度提升9.23%-80.86%,能耗降低66.21%-83.46%,准确率提升5.26%-194.13%。
原文摘要 · Abstract (English)
The right to be forgotten mandates that machine learning models enable the erasure of a data owner's data and information from a trained model. Removing data from the dataset alone is inadequate, as machine learning models can memorize information from the training data, increasing the potential privacy risk to users. To address this, multiple machine unlearning techniques have been developed and deployed. Among them, approximate unlearning is a popular solution, but recent studies report that its unlearning effectiveness is not fully guaranteed. Another approach, exact unlearning, tackles this issue by discarding the data and retraining the model from scratch, but at the cost of considerable computational and memory resources. However, not all devices have the capability to perform such retraining. In numerous machine learning applications, such as edge devices, Internet-of-Things (IoT), mobile devices, and satellites, resources are constrained, posing challenges for deploying existing exact unlearning methods. In this study, we propose a Constraint-aware Adaptive Exact Unlearning System at the network Edge (CAUSE), an approach to enabling exact unlearning on resource-constrained devices. Aiming to minimize the retrain overhead by storing sub-models on the resource-constrained device, CAUSE innovatively applies a Fibonacci-based replacement strategy and updates the number of shards adaptively in the user-based data partition process. To further improve the effectiveness of memory usage, CAUSE leverages the advantage of model pruning to save memory via compression with minimal accuracy sacrifice. The experimental results demonstrate that CAUSE significantly outperforms other representative systems in realizing exact unlearning on the resource-constrained device by 9.23%-80.86%, 66.21%-83.46%, and 5.26%-194.13% in terms of unlearning speed, energy consumption, and accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。