无需训练数据,从大模型中提取可复用的轻量适配器。
PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint
- 通过权重差分解生成低秩适配器,不依赖训练数据或梯度。
- 提取的适配器可剪枝且重合并后性能损失极小。
- 适合想快速部署轻量化推理服务的研究者和工程师。
我们提出PHLoRA(发音为'flora'),一种无需访问训练数据或梯度即可从全参数微调模型中提取低秩适配器的方法。该方法通过计算基础模型与微调后模型之间的权重差异的低秩分解,重建可在推理时合并或动态路由的适配模块,支持S-LoRA或NVIDIA NIM等平台部署。此方法将延迟开销分摊至多个请求,显著降低推理成本。与以往需逐个训练适配器的工作不同,PHLoRA将微调与适配器生成解耦,可直接从现有全参数模型或第三方检查点中提取适配器。在文本、图像和视频基准测试中使用Amazon Nova模型族进行实验表明,提取的适配器保留了高能量的权重差值,可安全剪枝,且重新合并后下游任务性能下降可忽略。总体而言,PHLoRA为所有现有全参数检查点提供适配器化路径,推动模型推理的规模化普及。
原文摘要 · Abstract (English)
We introduce PHLoRA (Pronounced "flora"). (Post-hoc LoRA), a simple yet powerful method to extract low-rank adaptation adapters from full-rank fine-tuned models without requiring access to training data or gradients. By computing the low-rank decomposition of weight differences between a base model and its fine-tuned counterpart, our method reconstructs adapter modules that can be merged or dynamically routed at inference time via S-LoRA, or served in scalable, industry settings using platforms like NVIDIA NIM. This approach amortizes latency overhead across requests and yields substantial cost savings. Unlike prior work that trains each adapter explicitly, our approach decouples fine-tuning from adapter generation, allowing adapter extraction from existing full-rank models or third-party checkpoints. Experiments on text, image, and video benchmarks using the Amazon Nova model family demonstrate that extracted adapters preserve high energy from the full weight delta, can be pruned safely, and yield negligible degradation in downstream task performance when re-merged. Overall, PHLoRA provides a practical path for making all existing full-rank checkpoints adapter-ready, democratizing scalable inference for all models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。