剖析DeepSeek-R1的思维链机制与推理局限性
DeepSeek-R1 Thoughtology: Let's think about LLM Reasoning
- 通过构建推理模块体系，系统分析模型思维链结构
- 发现推理长度存在性能最优区间，过长反而降低效果
- 揭示模型易陷入重复思考，且安全风险高于非推理版本
大型推理模型如DeepSeek-R1标志着大语言模型解决复杂问题方式的根本转变。与直接输出答案不同，DeepSeek-R1会生成详细的多步推理链，仿佛在‘思考’问题后再作答。该推理过程对用户完全开放，为研究模型推理行为提供了无限可能，也开启了‘思辨学（Thoughtology）’新领域。基于对DeepSeek-R1基本推理单元的分类，我们的分析考察了推理长度的影响与可控性、长或混乱上下文的处理能力、文化与安全问题，以及其与人类认知现象（如语言处理和世界建模）的关系。研究发现，模型存在‘最佳推理长度’，额外推理时间反而损害性能；同时表现出持续纠结于已探索问题形式的倾向，阻碍进一步探索。此外，相较于非推理版本，DeepSeek-R1存在显著安全漏洞，可能危及对齐型大模型的安全性。
原文摘要 · Abstract (English)
Large Reasoning Models like DeepSeek-R1 mark a fundamental shift in how LLMs approach complex problems. Instead of directly producing an answer for a given input, DeepSeek-R1 creates detailed multi-step reasoning chains, seemingly "thinking" about a problem before providing an answer. This reasoning process is publicly available to the user, creating endless opportunities for studying the reasoning behaviour of the model and opening up the field of Thoughtology. Starting from a taxonomy of DeepSeek-R1's basic building blocks of reasoning, our analyses on DeepSeek-R1 investigate the impact and controllability of thought length, management of long or confusing contexts, cultural and safety concerns, and the status of DeepSeek-R1 vis-à-vis cognitive phenomena, such as human-like language processing and world modelling. Our findings paint a nuanced picture. Notably, we show DeepSeek-R1 has a 'sweet spot' of reasoning, where extra inference time can impair model performance. Furthermore, we find a tendency for DeepSeek-R1 to persistently ruminate on previously explored problem formulations, obstructing further exploration. We also note strong safety vulnerabilities of DeepSeek-R1 compared to its non-reasoning counterpart, which can also compromise safety-aligned LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。