arXiv:2608.20927cs.CLcs.AI2026-08

让大模型指导小模型生成长文本时,动态刷新提示信号,效果更好。

MentorPulse: Refreshing Cross-Model Latent Guidance for Long-Form Generation

论文配图:MentorPulse: Refreshing Cross-Model Latent Guidance for Long-Form Generation
图 1 · 摘自论文原文
  • 用压缩记忆块动态更新小模型的提示信号,不重置缓存。
  • 每16个词刷新一次,比不用提示高出2.0分,比静态提示高4.5分。
  • 适合需要长文本生成且资源受限的场景,如智能助手、自动写作。

跨模型隐空间引导允许一个冻结的大模型(导师)对输入编码一次,由另一个冻结的小模型(学生)基于该信号生成内容。现有方法保持此信号不变,假设其始终有效,但在长文本生成中失效。在多轮指令遵循任务中,静态引导使40亿参数的学生模型约束满足度比无引导基线低2.5分;而每16个词进行一次无需训练的刷新,仅更新记忆内容,即可恢复相比基线高出2.0分的效果。我们提出MentorPulse:将导师状态压缩进有限槽位记忆,增量处理新生成的词元,通过门控交叉注意力更新记忆,且不重置学生模型的键值缓存。窗口化刷新训练暴露了前缀条件记忆的桥梁作用。在十三个数据集上,MentorPulse在宏观平均下缩小了52.2%的导师-学生性能差距,优于C2C、T2T和等预算LoRA,尤其在长输出任务中优势显著。在来自三个模型家族的十一个导师-学生组合上表现最佳,随着能力差距缩小,优势逐渐收敛。轻量级读取模式检查可预先预测增益。成本分析识别出刷新频率主导长文本引导效果。

原文摘要 · Abstract (English)

Cross-model latent guidance lets a frozen large mentor encode an input once and a frozen small student generate from the resulting signal. Existing methods keep this signal fixed, assuming it stays useful as the output grows; we show this fails in long-form generation. On multi-turn instruction following, static guidance pushes a 4B student's constraint satisfaction 2.5 points below its no-guidance baseline; a training-free refresh every 16 tokens changes only the memory content and restores a 2.0-point gain over that baseline. We propose MentorPulse to keep guidance fresh at practical cost: it compresses mentor states into a capped slot memory, incrementally processes newly generated tokens, and updates the memory that the student reads through gated cross-attention without resetting the student's KV cache. Windowed Refresh Training exposes the bridge to prefix-conditioned memory. Across thirteen datasets, MentorPulse closes 52.2% of the mentor-student gap on macro average, outperforming C2C, T2T, and equal-budget LoRA, with the largest gains on long outputs. It performs best on all eleven mentor-student pairs from three model families, with margins that narrow as the capability gap grows, and a lightweight read-pattern check predicts the gain before deployment. Measured costs identify refresh intervals that dominate text guidance on long outputs.

长文本生成跨模型引导动态刷新小模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。