arXiv:2506.05402cs.CRcs.LG2025-06中稿 · the ACM Conference…

Lorica 通过两阶段微调,让手机端模型更安全、更个性化。

Lorica: A Synergistic Fine-Tuning Framework for Advancing Personalized Adversarial Robustness

  • 用低秩适配参数只传关键数据,减少通信开销
  • 相比现有方法,通信效率提升68倍,抗攻击能力提高29.9%
  • 适合资源受限的移动端个性化防御场景

大模型在边缘计算中的应用日益广泛,但移动设备仍易受对抗攻击威胁。联邦对抗训练(FAT)虽能保护隐私并增强鲁棒性,却因客户端数据异构性导致全局模型泛化过度,个性化不足且通信开销高。本文提出Lorica框架,采用两阶段协同微调:第一阶段使用LoRA-FA进行本地对抗微调,仅上传低秩参数以降低通信量;第二阶段引入前向门控选择策略,提升正常准确率。实验表明,在基准数据集上,Lorica相较最先进方法通信效率提升68倍,对抗鲁棒性提升29.9%,正常准确率提升52.2%。

原文摘要 · Abstract (English)

The growing use of large pre-trained models in edge computing has made model inference on mobile clients both feasible and popular. Yet these devices remain vulnerable to adversarial attacks, threatening model robustness and security. Federated adversarial training (FAT) offers a promising solution by enhancing robustness while preserving client privacy. However, FAT often yields a generalized global model that struggles with heterogeneous client data, leading to limited personalization and significant communication overhead. In this paper, we propose \textit{Lorica}, a personalized synergistic adversarial training framework that delivers customized defense models through a two-phase process. In Phase 1, \textit{Lorica} applies LoRA-FA for local adversarial fine-tuning, enabling personalized robustness while reducing communication by uploading only LoRA-FA parameters. In Phase 2, a forward-gating selection strategy improves benign accuracy, further refining the personalized model. This yields tailored defense models that effectively balance robustness and accuracy. Extensive experiments on benchmark datasets demonstrate that \textit{Lorica} can achieve up to 68$\times$ improvements in communication efficiency compared to state-of-the-art algorithms, while achieving up to 29.9\% and 52.2\% enhancements in adversarial robustness and benign accuracy, respectively.

对抗鲁棒性联邦学习边缘计算低秩微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。