让大模型服务快速适应更新,保持性能不下降。
ReLoRA: Knowledge-Reusing Adaptation for Fast Rollout of Evolving LLM Services
- 用贝叶斯优化融合旧适配器与新模型信息,生成兼容性初始点。
- 分阶段微调:强正则先快速收敛,弱正则再精细优化任务性能。
- 适合需要频繁更新大模型的AI服务提供商,提速近9倍。
大型语言模型作为持续演进的服务部署日益普遍,但基础模型频繁更新会导致已部署的任务专用低秩适配器(LoRA)失效。对服务商而言,每次更新后从头重训所有LoRA成本过高,而直接沿用旧适配器又因适配器-主干不兼容导致性能下降。为此,本文提出ReLoRA,一种知识复用的再适配框架,可高效恢复服务就绪的LoRA适配器并保持或提升任务性能。ReLoRA包含两个关键优化步骤:1)自适应LoRA初始化利用贝叶斯优化,融合旧适配器与基础模型演化信息,构建兼容性起始点;2)带调度正则的微调:先以强正则快速引导至高质量区域,再通过宽松正则进行任务特化优化。该设计显著降低再适配开销,实现快速服务品质恢复。大量实验表明,相比基线,ReLoRA将就绪时间缩短最多8.9倍,准确率提升最高4.6%。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly deployed as continuously evolving services, where frequent base-model updates may invalidate previously deployed task-specific Low-Rank Adaptation (LoRA) adapters. For service providers managing numerous downstream model services, retraining each LoRA adapter from scratch for every updated base model is computationally prohibitive and delays service rollout. Meanwhile, the simpler alternative, i.e., naively applying the original LoRA adapter to the updated base model, often leads to degraded service quality due to adapter-backbone incompatibility. To address this problem, we propose ReLoRA, a knowledge-reusing re-adaptation framework that efficiently restores service-ready LoRA adapters for evolving LLM services while preserving or improving task performance. Specifically, ReLoRA comprises two key optimization steps: 1) Adaptive LoRA initialization leverages Bayesian optimization to construct a compatibility-aware starting point by fusing information from both the previously deployed task adapter and the base model's evolution; 2) Fine-tuning with scheduled regularization first rapidly steers the adapter to a high-quality region via strong regularization, followed by relaxed regularization for task-specific refinement. This design enables rapid service-quality recovery with reduced re-adaptation overhead. Extensive experiments demonstrate that ReLoRA reduces time-to-readiness by up to 8.9$\times$ and improves accuracy by up to 4.6\% compared to baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。