LoRA在多步骤流程任务中表现差,因无法捕捉高秩更新机制。
Procedural Knowledge Is Not Low-Rank: Why LoRA Fails to Internalize Multi-Step Procedures
- 通过系统消融实验发现,低秩微调在复杂流程任务中效果远逊于全量微调。
- 在旅行预订等任务中,LoRA成功率低于全量微调,且提升秩值改善有限。
- 适合关注大模型流程推理能力的开发者和研究者参考。
参数高效微调方法如LoRA已成为大语言模型适配的标准方案,在指令遵循、风格迁移和事实适应等方面表现良好。然而我们发现,对于程序性知识——即通过条件分支完成多步操作并抵达终态的能力——LoRA在保持效率优势的秩(r = 16–128)下,无法达到全量微调的效果。在14节点的程序化旅行预订任务中,所有LoRA配置均失败(任务成功率≤2.54,全量微调为4.11,所有p < 0.001),且成功率随秩增加而下降;尽管对话完成率仍达95%–99%。跨域复现于Zoom支持(14节点)与保险理赔(55节点)任务中,8B模型下洛拉在r=32和128时平均落后全量微调0.8–2.2分,复杂度越高差距越大。将秩从32增至128仅带来边际改善,未能弥合差距。对全量微调权重变化的SVD分析显示:三个领域在3B和8B模型下,更新的平均有效秩为761至1,026,而秩128仅捕捉43%–51%的平方Frobenius范数。这些结果表明,程序性任务中LoRA远逊于全量微调,这对智能体应用构成根本限制。
原文摘要 · Abstract (English)
Parameter-efficient fine-tuning methods like LoRA have become the default for adapting large language models, succeeding across instruction following, style transfer, and factual adaptation. We show that for procedural knowledge--the ability to follow multi-step procedures with conditional branching through to terminal states--LoRA fails to match full fine-tuning at the ranks where it retains its efficiency advantage. In a systematic ablation (r = 16--128) on a procedural travel booking task (14 nodes), all LoRA configurations fail uniformly (task success <= 2.54 vs. 4.11 for full fine-tuning, all p < 0.001), with scores decreasing at higher ranks--despite maintaining 95--99% conversation completion rates. Cross-domain replication on Zoom support (14 nodes) and insurance claims (55 nodes) at 8B confirms the failure generalizes: LoRA underperforms full fine-tuning by 0.8--2.2 points on average at both r = 32 and r = 128, with the largest gap on the most complex procedure. Quadrupling rank from 32 to 128 provides marginal improvement but does not close the gap. SVD analysis of the weight changes produced by full fine-tuning explains why: across three domains at both 3B and 8B, the mean effective rank of the update ranges from 761 to 1,026, and rank 128 captures only 43--51% of the squared Frobenius norm. Together, these findings establish that for procedural tasks LoRA falls well short of full fine-tuning--a fundamental limitation for agentic applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。