通过温度参数控制，大模型可生成固态、临界态或气态文本。
States of LLM-generated Texts and Phase Transitions between them
- 用温度参数调节生成文本的自相关特性
- 发现文本状态随参数变化呈现相变现象
- 适合对语言动力学与生成机制感兴趣的研究者
长期以来已知人类写作文本中词语的自相关性按幂律衰减。近期研究显示，大语言模型生成文本的自相关性衰减模式与文学文本有本质区别。固体物理将自相关衰减规律与物质状态关联。本文实证表明，根据温度参数的不同，大模型生成的文本可被分类为固态、临界态或气态。
原文摘要 · Abstract (English)
It is known for some time that autocorrelations of words in human-written texts decay according to a power law. Recent works have also shown that the autocorrelations decay in texts generated by LLMs is qualitatively different from the literary texts. Solid state physics tie the autocorrelations decay laws to the states of matter. In this work, we empirically demonstrate that, depending on the temperature parameter, LLMs can generate text that can be classified as solid, critical state or gas.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。