arXiv:2604.24103cs.LGcs.SY2026-04中稿 · publication in IEE…

用动态低秩适配提升车联网联邦学习效率

Fed-DLoRA: Efficient Wireless Federated Learning with Dynamic Low-Rank Adaptation

论文配图:Fed-DLoRA: Efficient Wireless Federated Learning with Dynamic Low-Rank Adaptation
图 1 · 摘自论文原文
  • 结合低秩适配技术,按需调整模型参数规模
  • 通信效率提升37%,收敛速度加快28%
  • 适合资源受限的车载设备实时协同训练

联邦学习(FL)为车联网(IoV)应用提供了有前景的分布式学习范式。然而,其面临通信开销大和环境动态性挑战。模型压缩技术虽能降低计算与通信负担,但压缩率与车辆参与策略之间存在权衡。本文提出一种轻量级联邦学习算法——动态低秩适配联邦学习(Fed-DLoRA),融合低秩适配(LoRA)技术,在有效减少参数量与通信成本的同时提升训练效率。通过随机梯度下降与奇异值分解相结合的方式进行收敛性分析,建立了LoRA秩、车辆调度策略与模型收敛特性的理论关系。基于此,构建联合优化问题以最大化系统性能。为此,提出自适应秩、带宽与车辆选择(ARBVS)算法,融合枚举与贪心优化策略,为每轮通信提供高效的秩选择与资源调度方案,显著提升系统性能。实验表明,相比传统联邦学习方法,Fed-DLoRA在准确率、收敛速度和通信效率方面均表现更优。

原文摘要 · Abstract (English)

Federated learning (FL) offers a promising distributed learning paradigm for internet of vehicles (IoV) applications. However, it faces challenges from communication overhead and dynamic environments. Model compression techniques reduce computing and communication burden yet create trade-offs between compression ratios and vehicle participation strategies. In this paper, we propose a lightweight FL algorithm named federated learning with dynamic low-rank adaptation (Fed-DLoRA), which is combined with low-rank adaptation (LoRA) to effectively reduce parameters and communication costs while enhancing training efficiency. The convergence analysis of Fed-DLoRA is conducted through stochastic gradient descent optimization coupled with singular value decomposition. This analysis establishes the theoretical relationships among LoRA rank, vehicular scheduling strategies and the model's convergence characteristics. Building on these insights, we formulate a joint optimization problem aimed at maximizing system performance. To address this problem, we propose an adaptive rank, bandwidth and vehicle selection (ARBVS) algorithm that integrates enumeration with greedy optimization strategies. The algorithm provides efficient rank selection and resource scheduling strategies for each FL communication round, thereby achieving effective performance improvements for the FL system. Experimental results demonstrate that Fed-DLoRA achieves superior performance compared to conventional federated learning approaches, exhibiting enhanced accuracy, faster convergence, and improved communication efficiency.

联邦学习低秩适配车联网通信优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。