arXiv:2601.06702cs.CL2026-01

用可学习的稀疏率代替网格搜索,高效实现多语言适配器优化。

GRASP LoRA: GRPO Guided Adapter Sparsity Policy for Cross Lingual Transfer

  • 将全局稀疏率设为可学习变量,通过在线反馈动态调整。
  • 在阿拉伯语和中文上提升摘要忠实度与问答准确率,优于基线方法。
  • 显著缩短训练时间,减少对开发集依赖,适合低资源场景。

参数高效微调是计算或数据受限时将大模型适配新语言的有效方式,但传统适配器管道通常通过网格搜索确定全局稀疏率,过程计算成本高且依赖大量开发集,重复训练并错过分数最优解。本文提出GRASP LoRA(GRPO引导的适配器稀疏策略),将全局稀疏率视为可学习控制变量。一个GRPO控制器在训练中穿插运行,定期在小型微开发集上探测候选稀疏率,并根据奖励信号在线更新单一全局稀疏率。该方法在冻结主干模型的前提下,对合并的源语言与目标语言LoRA适配器进行操作,以一次控制器运行替代网格搜索,学习最优稀疏率后,仅需一次最终合并与固定稀疏率的微调。在从英语到阿拉伯语、中文的跨语言迁移任务中,包括Llama 3 8B上的XL-Sum摘要与MLQA抽取式问答,GRASP LoRA在语义忠实度、内容覆盖率和答案质量上均优于强基线。其端到端训练时间减少数倍,降低对大规模开发集的依赖,使适配器复用更适用于低资源部署场景。

原文摘要 · Abstract (English)

Parameter efficient fine tuning is a way to adapt LLMs to new languages when compute or data are limited, yet adapter pipelines usually choose a global prune ratio by grid search. This practice is computationally expensive and development set intensive, since it repeats training, freezes sparsity, and misses fractional optima. We introduce GRASP LoRA (GRPO Guided Adapter Sparsity Policy), which treats global sparsity as a learnable control variable. A GRPO controller interleaves with training, periodically probing candidate prune ratios on a small micro development set and updating a single global prune ratio online from its reward signal. It operates on merged source and target LoRA adapters on a frozen backbone and replaces grid search with one controller run that learns a prune ratio, followed by a single final merge and prune fine tuning run with pruning fixed to that ratio. On cross lingual transfer from English into Arabic and Chinese, including XL-Sum summarization and MLQA extractive question answering with Llama 3 8B, GRASP LoRA improves semantic faithfulness, content coverage, and answer quality over strong target only and merge and prune baselines. It reduces end to end runtime by multiple times relative to grid search, lowers reliance on large development sets, and makes adapter reuse practical for low resource deployment.

参数高效多语言稀疏性适配器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。