无需训练数据和参数,用任务嵌入实现高效适配器路由。
Semantic Adapter Routing with Fine-Tuning Task Embeddings

- 将适配器选择转为分类问题,基于任务嵌入在隐空间中匹配最相近适配器。
- 在23个任务上达到97.4%的最优性能,44个适配器时准确率达89.7%。
- 适用于第三方适配器,无需训练数据或模型权重,适合快速部署场景。
参数高效微调(PEFT)催生了单个主干模型搭配多个任务专用适配器的生态。针对该生态中的适配器路由问题,现有方法通常需访问适配器权重或监督训练数据。本文提出ARIADNE,一种无需训练的语义适配器路由方法,将适配器表示为任务嵌入,并将未标注查询路由至编码器隐空间中最近的适配器。在23项任务上,ARIADNE恢复了97.4%的最优任务性能,支持44个适配器时选择准确率达89.7%,且不修改任何适配器参数。当适配器来自公共库或第三方时,训练数据可能不可用。为此,本文提出GRACE,仅通过适配器输出的logits,利用改进的对比解码差分(CDD)过程恢复微调数据,生成合成数据以构建任务嵌入。在三个主干模型(Llama-3.2-1B、Qwen2.5-3B、Qwen2.5-32B)上,GRACE恢复了72–100%的最优任务准确率,在69组任务/主干组合中,48组表现优于或等同于ARROW,且无需训练数据或模型权重。结果表明,微调任务嵌入是实现精确高效语义适配器路由的有效路径。
原文摘要 · Abstract (English)
Parameter-efficient fine-tuning (PEFT) has led to model ecosystems in which a single backbone is paired with many task-specialized adapters. Given such a library, routing aims to select the most appropriate adapter for a user query. While existing adapter routers typically require access to adapter weights or supervised training, we develop training-free semantic adapter routing methods using task embeddings. In ARIADNE, we reframe adapter selection as a classification problem, where PEFT adapters are represented by task embeddings and an unlabeled query is routed to the nearest adapter in the encoder's latent space. Evaluated on 23 tasks, ARIADNE recovers 97.4% of Oracle task performance and scales to 44 adapters at 89.7% selection accuracy, without touching a single adapter parameter. However, training data needed for ARIADNE may not be available when adapters come from public hubs or third-party providers. To overcome this limitation, we introduce GRACE, which recovers an adapter's fine-tuning data from its output logits alone via a modified contrastive decoding diffing (CDD) procedure. Synthetic data generated from CDD-UM is then used to construct task embeddings. Across three backbones (Llama-3.2-1B, Qwen2.5-3B, Qwen2.5-32B), GRACE recovers 72--100\% of Oracle task accuracy and matches or exceeds ARROW on 48 of 69 task/backbone combinations, while requiring neither training data nor model weights. Overall, we demonstrate that fine-tuning task embeddings provide an accurate and efficient path to semantic adapter routing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。