只需输入任务提示,即可秒生成适配参数,无需训练。
Drag-and-Drop LLMs: Zero-Shot Prompt-to-Weights
- 用提示词直接生成LoRA参数,跳过传统微调流程。
- 性能比最优训练LoRA高30%,推理速度提升12000倍。
- 适合快速部署新任务,尤其擅长跨领域应用。
现代参数高效微调方法如低秩适应(LoRA)虽降低了定制大语言模型的成本,但仍需为每个下游数据集单独进行优化。我们提出「拖拽式大模型(DnD)」,一种提示条件参数生成器,通过将少量未标注的任务提示直接映射为LoRA权重更新,彻底消除每项任务的训练需求。轻量级文本编码器将提示批处理压缩为条件嵌入,再经级联超卷积解码器生成完整的LoRA矩阵。在多样化提示-检查点对上训练后,DnD可在数秒内生成特定任务参数,实现:一、相比全量微调降低12,000倍开销;二、在未见的常识推理、数学、编程及多模态基准上,平均性能较最强训练型LoRA提升高达30%;三、即使未接触目标数据或标签,仍具备稳健的跨域泛化能力。结果表明,提示条件参数生成是梯度微调之外的一种可行替代方案。项目地址:https://jerryliang24.github.io/DnD。
原文摘要 · Abstract (English)
Modern Parameter-Efficient Fine-Tuning (PEFT) methods such as low-rank adaptation (LoRA) reduce the cost of customizing large language models (LLMs), yet still require a separate optimization run for every downstream dataset. We introduce \textbf{Drag-and-Drop LLMs (\textit{DnD})}, a prompt-conditioned parameter generator that eliminates per-task training by mapping a handful of unlabeled task prompts directly to LoRA weight updates. A lightweight text encoder distills each prompt batch into condition embeddings, which are then transformed by a cascaded hyper-convolutional decoder into the full set of LoRA matrices. Once trained in a diverse collection of prompt-checkpoint pairs, DnD produces task-specific parameters in seconds, yielding i) up to \textbf{12,000$\times$} lower overhead than full fine-tuning, ii) average gains up to \textbf{30\%} in performance over the strongest training LoRAs on unseen common-sense reasoning, math, coding, and multimodal benchmarks, and iii) robust cross-domain generalization despite never seeing the target data or labels. Our results demonstrate that prompt-conditioned parameter generation is a viable alternative to gradient-based adaptation for rapidly specializing LLMs. Our project is available at \href{https://jerryliang24.github.io/DnD}{https://jerryliang24.github.io/DnD}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。