arXiv:2601.22546cs.CLcs.AI2026-01

发现大模型生成文本时会早期捕捉关键词,据此提出高效生成插件HOLO。

Towards the Holographic Characteristic of LLMs for Efficient Short-text Generation

  • 大模型生成初期会优先捕获目标关键词,形成全息特征。
  • HOLO插件在有限步骤内提取关键词,实现与基线相当的生成效果。
  • 适合追求短文本生成效率的研究者和工程应用开发者。

近年来大语言模型(LLMs)在上下文学习和思维链能力方面取得进展,但对其强大生成能力的具体特征研究仍较少。本文深入探究了大模型的生成特性,发现其在生成初期倾向于捕获目标侧关键词,称之为语言模型的全息特征。为探索该特性并提升推理效率,本文提出名为HOLO的插件,利用全息特征在有限生成步数内提取目标关键词,并结合并行词汇约束生成方法补全句子。我们在不同架构和规模的语言模型上进行了大规模实验,验证了其在短文本生成场景下的有效性。结果表明,HOLO在自动评估和人工评价指标上均达到与基线相当的性能,凸显了全息特征的潜力。

原文摘要 · Abstract (English)

The recent advancements in Large Language Models (LLMs) have attracted interest in exploring their in-context learning abilities and chain-of-thought capabilities. However, there are few studies investigating the specific traits related to the powerful generation capacity of LLMs. This paper aims to delve into the generation characteristics exhibited by LLMs. Through our investigation, we have discovered that language models tend to capture target-side keywords at the beginning of the generation process. We name this phenomenon the Holographic Characteristic of language models. For the purpose of exploring this characteristic and further improving the inference efficiency of language models, we propose a plugin called HOLO, which leverages the Holographic Characteristic to extract target-side keywords from language models within a limited number of generation steps and complements the sentence with a parallel lexically constrained text generation method. To verify the effectiveness of HOLO, we conduct massive experiments on language models of varying architectures and scales in the short-text generation scenario. The results demonstrate that HOLO achieves comparable performance to the baselines in terms of both automatic and human-like evaluation metrics and highlight the potential of the Holographic Characteristic.

大模型生成全息特征效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。