让大模型暴露向量提示接口,实现更稳定可控的定制化。
Position: Vector Prompt Interfaces Should Be Exposed to Enable Customization of Large Language Models
- 用向量提示替代纯文本提示,提升模型定制能力
- 向量提示在更多监督下持续优化,文本提示则早期饱和
- 适合需要高效、安全定制的大模型部署场景
随着大语言模型从研究原型走向实际系统,定制化已成为核心瓶颈。尽管文本提示可调整模型行为,但仅靠文本提示难以实现可扩展、稳定且仅限推理阶段的定制。本文主张模型提供方应将向量提示输入作为公开接口,以支持定制。实证分析显示,向量提示在更多监督下仍持续提升性能,而文本提示则早期饱和;同时,向量提示表现出密集、全局的注意力模式,表明其具备独立控制机制。在现实部署约束下,仅推理定制愈发重要,且在标准黑盒威胁模型下,暴露向量提示不显著增加模型泄露风险。文章呼吁社区将提示接口视为大模型定制的核心组成部分。
原文摘要 · Abstract (English)
As large language models (LLMs) transition from research prototypes to real-world systems, customization has emerged as a central bottleneck. While text prompts can already customize LLM behavior, we argue that text-only prompting does not constitute a suitable control interface for scalable, stable, and inference-only customization. This position paper argues that model providers should expose \emph{vector prompt inputs} as part of the public interface for customizing LLMs. We support this position with diagnostic evidence showing that vector prompt tuning continues to improve with increasing supervision whereas text-based prompt optimization saturates early, and that vector prompts exhibit dense, global attention patterns indicative of a distinct control mechanism. We further discuss why inference-only customization is increasingly important under realistic deployment constraints, and why exposing vector prompts need not fundamentally increase model leakage risk under a standard black-box threat model. We conclude with a call to action for the community to rethink prompt interfaces as a core component of LLM customization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。