arXiv:2502.08515cs.LG2025-02被引 9

调高温度没提升创意,模型架构才决定生成效率

The Paradox of Stochasticity: Limited Creativity and Computational Decoupling in Temperature-Varied LLM Outputs of Structured Fictional Data

  • 测试0.0~1.0温度下三模型生成虚构数据的效率与多样性
  • 温度不影响速度,但模型差异导致处理快8倍,输出仍偏常见名字
  • 适合关注生成数据质量与效率优化的研究者参考

本研究考察了温度设置与模型架构对三种大语言模型(llama3.1:8b、deepseek-r1:8b、mistral:latest)生成结构化虚构数据(姓名、出生日期)的影响。系统性测试0.0至1.0间0.1间隔的温度值,共完成330次实验,产出889个结构化实体,并验证其语法一致性。关键发现显示,模型架构显著影响计算效率:mistral:latest与llama3.1:8b的处理速度比deepseek-r1:8b快8倍。出乎意料的是,温度与处理时间无相关性,挑战了随机采样成本的既有假设。输出多样性有限,所有温度下模型均倾向使用常见姓名原型(如'John Doe'、'Jane Smith'),尽管罕见姓名在中间温度值(0.3–0.7)集中出现。结果表明,在结构化生成任务中,架构优化远超温度调节的作用。研究强调应优先选择模型而非调参以提升效率,并指出需引入显式多样性约束,以缓解合成数据流水线中的默认输出偏差。

原文摘要 · Abstract (English)

This study examines how temperature settings and model architectures affect the generation of structured fictional data (names, birthdates) across three large language models (LLMs): llama3.1:8b, deepseek-r1:8b, and mistral:latest. By systematically testing temperature values from 0.0 to 1.0 in increments of 0.1, we conducted 330 trials yielding 889 structured entities, validated for syntactic consistency. Key findings reveal that model architecture significantly influences computational efficiency, with mistral:latest and llama3.1:8b processing data 8x faster than deepseek-r1:8b. Contrary to expectations, temperature showed no correlation with processing time, challenging assumptions about stochastic sampling costs. Output diversity remained limited, as models consistently defaulted to common name archetypes (e.g., 'John Doe' and 'Jane Smith') across all temperatures, though rare names clustered at intermediate values (0.3-0.7). These results demonstrate that architectural optimizations, rather than temperature adjustments, dominate performance in structured generation tasks. The findings emphasize prioritizing model selection over hyperparameter tuning for efficiency and suggest explicit diversity constraints are necessary to mitigate default output biases in synthetic data pipelines.

LLM生成温度调节数据质量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。