在有限神经架构中模拟直觉与推理的分工,验证了模型内部可形成类推理结构。
AI Mental Models: Learned Intuition and Deliberation in a Bounded Neural Architecture
- 设计双路径架构,分离直觉与推理模块进行对比实验。
- 推理路径相关性达0.8152,显著优于直觉路径的0.7272(p=0.0101)。
- 发现稀疏分化内部状态,体现类推理组织,适合研究认知机制的模型设计。
本文探讨有限神经架构能否在经典的64项三段论推理基准上表现出有意义的直觉与推理分工。该基准对当前关于世界模型与多阶段推理的讨论具有参考价值,提供了一个可控环境,用于检验学习系统是否能发展出结构化内部计算,而非仅依赖一次性关联预测。实验1评估直接神经基线在五折交叉验证下预测完整9类人类响应分布的表现。实验2引入受约束的双路径架构,受计算心理模型理论启发(Khemlani & Johnson-Laird, 2022)。在交叉验证中,受限直觉路径的综合相关系数为r = 0.7272,受限推理路径达到r = 0.8152,且推理优势在各折间显著(p = 0.0101)。最大保留损失提升出现在NVC、Eca和Oca类别,表明对拒绝反应和c-a结论的处理能力增强。一次80:20可解释性分析与五次种子稳定性测试进一步显示,推理路径发展出稀疏、差异化的内部结构,包括一个偏向Oac的状态、一个主导工作状态,以及若干弱使用或未使用的状态,其具体索引在不同运行中变化。这些结果支持在受限条件下存在类推理的内部组织,但不声称模型复现了完整的建模、反例搜索与结论修正的序列过程。
原文摘要 · Abstract (English)
This paper asks whether a bounded neural architecture can exhibit a meaningful division of labor between intuition and deliberation on a classic 64-item syllogistic reasoning benchmark. More broadly, the benchmark is relevant to ongoing debates about world models and multi-stage reasoning in AI. It provides a controlled setting for testing whether a learned system can develop structured internal computation rather than only one-shot associative prediction. Experiment 1 evaluates a direct neural baseline for predicting full 9-way human response distributions under 5-fold cross-validation. Experiment 2 introduces a bounded dual-path architecture with separate intuition and deliberation pathways, motivated by computational mental-model theory (Khemlani & Johnson-Laird, 2022). Under cross-validation, bounded intuition reaches an aggregate correlation of r = 0.7272, whereas bounded deliberation reaches r = 0.8152, and the deliberation advantage is significant across folds (p = 0.0101). The largest held-out gains occur for NVC, Eca, and Oca, suggesting improved handling of rejection responses and c-a conclusions. A canonical 80:20 interpretability run and a five-seed stability sweep further indicate that the deliberation pathway develops sparse, differentiated internal structure, including an Oac-leaning state, a dominant workhorse state, and several weakly used or unused states whose exact indices vary across runs. These findings are consistent with reasoning-like internal organization under bounded conditions, while stopping short of any claim that the model reproduces full sequential processes of model construction, counterexample search, and conclusion revision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。