arXiv:2409.17834cs.CL2024-09被引 13

通过提示依赖向量修改,实现高效微调且性能更优。

PEDRO: Parameter-Efficient Fine-tuning with Prompt DEpenDent Representation MOdification

  • 在每层Transformer中加入轻量级向量生成器,根据输入提示动态调整隐藏表示。
  • 参数量相当的情况下,性能优于主流PEFT方法,推理效率高于LoRA。
  • 适合需要多任务共享大模型的工业场景,如云服务中的多租户部署。

由于规模庞大,大型语言模型(LLMs)通常部署于单骨干多租户框架中。在此架构下,一个LLM实例需通过多种参数高效微调(PEFT)模型支持多个用户或任务。尽管已有如LoRA等有效方法,仍缺乏兼具高推理效率与下游任务竞争力的PEFT方案。本文提出一种新颖且简洁的PEFT方法——提示依赖表示修改(PEDRO)。该方法在每个Transformer层中引入轻量级向量生成器,根据输入提示生成向量,并通过点积操作修改模型的隐藏表示,从而影响语义输出和生成内容。大量实验表明:(a) 在相似可调参数数量下,PEDRO超越近期主流PEFT基准;(b) 在单骨干多租户部署模式中,其推理效率显著优于LoRA,展现出重要工业应用潜力。

原文摘要 · Abstract (English)

Due to their substantial sizes, large language models (LLMs) are typically deployed within a single-backbone multi-tenant framework. In this setup, a single instance of an LLM backbone must cater to multiple users or tasks through the application of various parameter-efficient fine-tuning (PEFT) models. Despite the availability of numerous effective PEFT techniques such as LoRA, there remains a need for a PEFT approach that achieves both high efficiency during inference and competitive performance on downstream tasks. In this research, we introduce a new and straightforward PEFT methodology named \underline{P}rompt D\underline{E}pen\underline{D}ent \underline{R}epresentation M\underline{O}dification (PEDRO). The proposed method involves integrating a lightweight vector generator into each Transformer layer, which generates vectors contingent upon the input prompts. These vectors then modify the hidden representations created by the LLM through a dot product operation, thereby influencing the semantic output and generated content of the model. Extensive experimentation across a variety of tasks indicates that: (a) PEDRO surpasses recent PEFT benchmarks when using a similar number of tunable parameters. (b) Under the single-backbone multi-tenant deployment model, PEDRO exhibits superior efficiency compared to LoRA, indicating significant industrial potential.

参数高效微调提示工程大模型部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。