arXiv:2603.19519cs.CLcs.AI2026-03被引 2

让大模型持续输出创意与多样性,突破传统生成的单一性。

Inducing Sustained Creativity and Diversity in Large Language Models

  • 设计新解码策略,动态激发模型长期创造力
  • 可生成任意数量概念独特结果,不重复且不偏离主题
  • 适合需要深度探索的用户,如创意构思或研究选题

我们针对一种未被充分关注的探索性搜索场景:用户需经历漫长‘搜寻之旅’,寻找完美的婚礼礼服、冷门研究课题或颠覆性商业创意。当前大语言模型(LLMs)的前几条输出虽有帮助,但仅是起点,因该过程需持续学习搜索空间并评估大量多样且富有创意的选项。尽管LLMs编码了世界知识的极大部分,但常见解码方法仅针对有正确答案的提示优化,导致结果高度同质化和保守。现有提升多样性方法在少数答案后即开始重复,或对所有相似问题提供均一化‘创意’。本文提出一种新颖、易实现的解码方案,可在不访问模型内部向量空间的前提下,持续激发大模型的创造力与多样性,生成任意数量的概念独特结果。该算法释放了模型中既主流又异端的广泛知识,远超常规解码路径。使用该方法后,搜寻用户能更快探索整个搜索空间,更高效地找到满意答案。

原文摘要 · Abstract (English)

We address a not-widely-recognized subset of exploratory search, where a user sets out on a typically long "search quest" for the perfect wedding dress, overlooked research topic, killer company idea, etc. The first few outputs of current large language models (LLMs) may be helpful but only as a start, since the quest requires learning the search space and evaluating many diverse and creative alternatives along the way. Although LLMs encode an impressive fraction of the world's knowledge, common decoding methods are narrowly optimized for prompts with correct answers and thus return mostly homogeneous and conventional results. Other approaches, including those designed to increase diversity across a small set of answers, start to repeat themselves long before search quest users learn enough to make final choices, or offer a uniform type of "creativity" to every user asking similar questions. We develop a novel, easy-to-implement decoding scheme that induces sustained creativity and diversity in LLMs, producing as many conceptually unique results as desired, even without access to the inner workings of an LLM's vector space. The algorithm unlocks an LLM's vast knowledge, both orthodox and heterodox, well beyond modal decoding paths. With this approach, search quest users can more quickly explore the search space and find satisfying answers.

大模型创造力多样性解码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。