arXiv:2411.18220eess.SPcs.AI2024-11被引 2

提出抗干扰的多任务大模型融合方法,保障边缘设备协作时的模型可靠性。

R-MTLLMF: Resilient Multi-Task Large Language Model Fusion at the Wireless Edge

  • 通过重对齐多任务向量,抵御对抗噪声对模型融合的破坏。
  • 理想场景下八项任务性能接近基线,对抗场景下显著优于未防护方案。
  • 适合需要安全协同训练大模型的边缘智能应用开发者。

多任务大语言模型(MTLLMs)在无线边缘场景中至关重要,用户需高效处理多种任务。然而,当任务动态变化时,训练复杂且耗时。近期基于任务向量的模型融合成为高效整合微调参数的方法。本文研究了在最坏情况对抗攻击下,边缘用户如何协作利用任务向量构建MTLLM。首先分析对抗噪声对多任务模型融合的影响,推导出权重解耦误差与均方误差(MSE)之间的关系。通过假设检验表明,MSE升高会加剧任务向量间的干扰,导致融合失效。为此,提出一种新型抗干扰多任务大模型融合方法(R-MTLLMF),结合大模型架构与微调机制,通过重对齐实现鲁棒的任务向量聚合。在理想与最坏传输场景下对比实验验证有效性:理想条件下,八项任务性能接近基线;最坏情况下,显著优于无保护融合。结果强调需从无线与大模型双视角加强物理层防护,以实现整体韧性。

原文摘要 · Abstract (English)

Multi-task large language models (MTLLMs) are important for many applications at the wireless edge, where users demand specialized models to handle multiple tasks efficiently. However, training MTLLMs is complex and exhaustive, particularly when tasks are subject to change. Recently, the concept of model fusion via task vectors has emerged as an efficient approach for combining fine-tuning parameters to produce an MTLLM. In this paper, the problem of enabling edge users to collaboratively craft such MTLMs via tasks vectors is studied, under the assumption of worst-case adversarial attacks. To this end, first the influence of adversarial noise to multi-task model fusion is investigated and a relationship between the so-called weight disentanglement error and the mean squared error (MSE) is derived. Using hypothesis testing, it is directly shown that the MSE increases interference between task vectors, thereby rendering model fusion ineffective. Then, a novel resilient MTLLM fusion (R-MTLLMF) is proposed, which leverages insights about the LLM architecture and fine-tuning process to safeguard task vector aggregation under adversarial noise by realigning the MTLLM. The proposed R-MTLLMF is then compared for both worst-case and ideal transmission scenarios to study the impact of the wireless channel. Extensive model fusion experiments with vision LLMs demonstrate R-MTLLMF's effectiveness, achieving close-to-baseline performance across eight different tasks in ideal noise scenarios and significantly outperforming unprotected model fusion in worst-case scenarios. The results further advocate for additional physical layer protection for a holistic approach to resilience, from both a wireless and LLM perspective.

多任务学习边缘计算模型融合抗干扰

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。