对比大模型与人类在概念压缩与意义间的权衡,发现模型过度压缩损失语义细节。
From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning
- 用信息瓶颈框架比较40多个大模型与人类概念结构
- 模型压缩更优但细粒度语义区分能力弱于人类
- 编码器模型比更大解码器更贴近人类认知,适合研究理解机制
人类将知识组织成紧凑的概念类别,平衡压缩效率与语义丰富性。大型语言模型(LLMs)表现出色的语言能力,但其是否在压缩与意义之间进行类似权衡尚不明确。我们采用信息瓶颈框架,通过经典分类基准对比40多个LLM的嵌入表示与人类概念结构。结果发现,尽管大模型大致符合人类类别边界,但在细微语义区分上表现不足。与保留‘低效’表征以维持上下文细微差别的自然人类不同,大模型主动压缩,虽实现更优的信息论压缩,却牺牲了语义丰富性。令人意外的是,编码器模型在与人类对齐方面优于更大规模的解码器模型,暗示理解与生成依赖不同的表征机制。训练动态分析揭示双阶段轨迹:初期快速形成概念,随后经历架构重组,语义处理从深层向中层迁移,模型逐步发现更高效、更稀疏的编码方式。这种策略差异——模型优化压缩,人类追求适应性效用——凸显人工智能与自然智能的根本区别,强调未来模型需保留对人类理解至关重要的概念‘低效性’。
原文摘要 · Abstract (English)
Humans organize knowledge into compact conceptual categories that balance compression with semantic richness. Large Language Models (LLMs) exhibit impressive linguistic abilities, but whether they navigate this same compression-meaning trade-off remains unclear. We apply an Information Bottleneck framework to compare human conceptual structure with embeddings from 40+ LLMs using classic categorization benchmarks. We find that LLMs broadly align with human category boundaries, yet fall short on fine-grained semantic distinctions. Unlike humans, who maintain ``inefficient'' representations that preserve contextual nuance, LLMs aggressively compress, achieving more optimal information-theoretic compression at the cost of semantic richness. Surprisingly, encoder models outperform much larger decoder models in human alignment, suggesting that understanding and generation rely on distinct representational mechanisms. Training-dynamics analysis reveals a two-phase trajectory: rapid initial concept formation followed by architectural reorganization, during which semantic processing migrates from deep to mid-network layers as the model discovers increasingly efficient, sparser encodings. These divergent strategies, where LLMs optimize for compression and humans for adaptive utility, reveal fundamental differences between artificial and natural intelligence. This highlights the need for models that preserve the conceptual ``inefficiencies'' essential for human-like understanding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。