arXiv:2506.04650cs.LG2025-06被引 4

提出统一框架,揭示模型重编程、提示调优等方法的共性原理。

Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction

  • 通过接口操控信息实现参数冻结下的模型重用
  • 涵盖输入扰动、中间层插入、上下文示例等多种操作方式
  • 适合研究高效微调与跨模态适配的学者参考

随着大规模预训练基础模型持续扩大规模与能力,高效适配其至下游任务变得愈发关键。尽管已有显著进展,现有适配方法长期各自发展,缺乏对彼此关系的清晰理解。本文提出神经网络可重编程性作为统一框架,连接主流模型适配技术——模型重编程、提示调优与提示指令——这些此前分散的研究领域实则共享同一原则:在保持模型参数冻结的前提下,通过操纵模型接口处的信息来重用预训练模型。这些方法利用神经网络对不同接口上操作的敏感性,如扰动输入、在中间层插入标记或提供上下文中的任务示例,以引导模型行为向期望结果偏移。我们进一步构建分类体系,从操控形式(固定或可学习)、位置(操作发生界面)、算子(应用方式)和输出对齐需求(是否需后处理)四个维度对这类基于信息操控的适配方法进行归纳。该框架具有跨模态普适性,不依赖特定模型架构。将已有技术如上下文学习与思维链提示置于该视角下分析,揭示其理论关联与实践差异。最后,我们探讨现存技术挑战与伦理考量,提出该范式为高效模型适配的根本路径,并指出由此衍生的未来研究方向。

原文摘要 · Abstract (English)

As large-scale pre-trained foundation models continue to expand in size and capability, efficiently adapting them to specific downstream tasks has become increasingly critical. Despite substantial progress, existing adaptation approaches have evolved largely in isolation, without a clear understanding of their interrelationships. This survey introduces neural network reprogrammability as a unifying framework that bridges mainstream model adaptation techniques--model reprogramming, prompt tuning, and prompt instruction--previously fragmented research areas yet converges on a shared principle: repurposing a pre-trained model by manipulating information at the interfaces while keeping the model parameters frozen. These methods exploit neural networks' sensitivity to manipulation on different interfaces, be it through perturbing inputs, inserting tokens into intermediate layers, or providing task-specific examples in context, to redirect model behaviors towards desired outcomes. We then present a taxonomy that categorizes such information manipulation-based adaptation approaches across four key dimensions: manipulation format (fixed or learnable), location (interfaces where manipulations occur), operator (how they are applied), and output alignment requirement (post-processing needed to align outputs with downstream tasks). Notably, this framework applies consistently across data modalities, independent of specific model architectures. Moreover, viewing established techniques like in-context learning and chain-of-thought prompting through this lens reveals both their theoretical connections and practical distinctions. We further analyze remaining technical challenges and ethical considerations, positioning neural network reprogrammability as a fundamental paradigm for efficient model adaptation. We lastly identify promising research directions emerging from this integrative viewpoint.

模型重编程提示调优统一框架高效适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。