arXiv:2609.01615cs.LG2026-09

冻结大模型的提示元学习无法跨用户迁移,因目标函数失效。

Prompt-Space Meta-Learning Does Not Transfer Across Users: A Frozen-LLM Negative Result

论文配图:Prompt-Space Meta-Learning Does Not Transfer Across Users: A Frozen-LLM Negative Result
图 1 · 摘自论文原文
  • 用进化优化共享提示词,在元训练中模拟用户个性化
  • 在200个新用户上表现不及基础提示和检索方法
  • 发现元目标坍塌是主因,无法区分真实用户关联

将冻结的大语言模型个性化为个体用户常被视为提示空间中的元学习问题:每个用户为一个任务,目标是寻找一种共享的自然语言适配策略,仅凭少量用户标注交互即可配置模型。该框架吸引力强,因其与骨干网络无关且复用提示优化工具,但领域极少检验其优化后的元目标是否编码了可转移的跨用户适应能力,而非通用指令质量。我们通过Muse(基于共享进化的元学习用户适配)研究此问题:通过反思性提示进化在元训练用户群体上优化单一共享适配提示,冻结后零样本应用于保留用户;匹配对照组隔离了措辞与选择的混淆因素。在两个标准个性化基准(LaMP-2分类和LaMP-3评分)上,对各200名保留用户测试,Muse的表现显著不如自身未进化的种子提示或结构破坏控制组(在不匹配用户-支持对上元训练),且在评分任务上被简单少样本检索超越(ΔMAE +0.175,p < 0.001)。我们归因于单一机制——元目标坍塌:元验证目标在用户-支持对应关系是否真实时统计不变(LaMP-2 p=0.555,LaMP-3 p=0.622),故无法优化出可转移的适配能力,反而奖励指令润色与验证过拟合。种子提示、错误支持及不变性预言机对照组构成可复用协议,以分离真正学习的适配与这些混淆因素。

原文摘要 · Abstract (English)

Personalizing a frozen large language model (LLM) to individual users is often framed as a meta-learning problem in prompt space: each user is a task, and one seeks a shared natural-language adaptation policy that, given a handful of the user's labeled interactions, configures the frozen model for that user. The framing is attractive because it is backbone-agnostic and reuses the machinery of prompt optimization, yet the field rarely tests whether the optimized meta-objective encodes transferable cross-user adaptation rather than generic instruction quality. We study this question with Muse (Meta-learned User-adaptation via Shared Evolution), which evolves a single shared adaptation prompt over a meta-train user population by reflective prompt evolution, freezes it, and applies it zero-shot to held-out users; matched controls isolate learning from confounds of phrasing and selection. On two standard personalization benchmarks (LaMP-2 categorization and LaMP-3 rating) over 200 held-out users each, Muse does not significantly improve on its own un-evolved seed prompt or on a structure-broken control that meta-trains on mismatched user-support pairs, and is dominated by plain few-shot retrieval on the rating task (Delta MAE +0.175, p < 0.001). We attribute these outcomes to a single mechanism, meta-objective collapse: the meta-validation objective is statistically invariant to whether the user-support correspondence is genuine (p=0.555 on LaMP-2, p=0.622 on LaMP-3), so it cannot be optimized into transferable adaptation and instead rewards instruction polish and validation overfitting. The seed-prompt, wrong-support, and invariance-oracle controls form a reusable protocol that separates learned adaptation from these confounds.

元学习提示工程大模型用户建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。