LLM更爱加东西,而不是删减,可能浪费资源。
More is More: Addition Bias in Large Language Models
- 测试发现模型倾向添加而非删除修改
- 如生成回文时97.85%选择加字母
- 适合关注效率与可持续性的开发者
本文研究大型语言模型(LLMs)中的添加偏见,类比人类倾向于偏好增加而非减少的认知偏差。通过一系列受控实验,测试了GPT-3.5 Turbo、Claude 3.5 Sonnet、Mistral、MathΣtral和Llama 3.1等模型在衡量其添加与删减修改倾向的任务表现。结果表明所有模型均显著偏好添加操作:在回文生成任务中,Llama 3.1 97.85%时间选择加字母而非移除;在乐高塔平衡任务中,GPT-3.5 Turbo 76.38%时间选择加砖块;在文本摘要任务中,Mistral 7B在59.40%至75.10%情况下生成更长摘要。这表明,与人类类似,LLMs表现出明显的添加偏见,可能在大规模应用中导致资源过度消耗、环境影响加剧及经济成本上升。该偏见应在模型开发与应用中予以重视,以实现更均衡高效的解决问题方式。
原文摘要 · Abstract (English)
In this paper, we investigate the presence of additive bias in Large Language Models (LLMs), drawing a parallel to the cognitive bias observed in humans where individuals tend to favor additive over subtractive changes. Using a series of controlled experiments, we tested various LLMs, including GPT-3.5 Turbo, Claude 3.5 Sonnet, Mistral, Math$Σ$tral, and Llama 3.1, on tasks designed to measure their propensity for additive versus subtractive modifications. Our findings demonstrate a significant preference for additive changes across all tested models. For example, in a palindrome creation task, Llama 3.1 favored adding letters 97.85% of the time over removing them. Similarly, in a Lego tower balancing task, GPT-3.5 Turbo chose to add a brick 76.38% of the time rather than remove one. In a text summarization task, Mistral 7B produced longer summaries in 59.40% to 75.10% of cases when asked to improve its own or others' writing. These results indicate that, similar to humans, LLMs exhibit a marked additive bias, which might have implications when LLMs are used on a large scale. Addittive bias might increase resource use and environmental impact, leading to higher economic costs due to overconsumption and waste. This bias should be considered in the development and application of LLMs to ensure balanced and efficient problem-solving approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。