arXiv:2512.24014cs.CLcs.AI2025-12被引 1

让大模型像人一样用潜意识思维规划,提升推理准确性和泛化能力。

iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning

  • 用隐式认知思想构建压缩的潜在计划编码,替代传统显式文字步骤
  • 在数学推理和代码生成任务中,准确率显著提升且推理更高效
  • 保持思维链可解释性,适合需要可靠推理的跨领域应用

大型语言模型(LLMs)在显式文本计划引导下可进行可靠的逐步推理。然而,由于模型幻觉和任务问题多样性,生成准确有效的文本计划仍具挑战。受人类隐式认知(IC)启发——即通过过往经验学习紧凑、通用模式而无需明确表述——我们提出iCLP框架,使LLMs能自适应生成潜在计划(LPs),即有效推理指令的紧凑编码。iCLP首先从现有逐步推理轨迹中提炼显式计划,再通过向量量化自编码器与码本学习其离散表示。最后,通过在潜在计划与对应推理步骤对上微调LLMs,模型学会在推理时进行隐式规划。实验结果表明,iCLP使LLMs能在潜在空间规划、语言空间推理,显著提升数学推理与代码生成任务的准确率与效率,并展现出强大的跨领域泛化能力,同时保留思维链推理的可解释性。

原文摘要 · Abstract (English)

Large language models (LLMs), when guided by explicit textual plans, can perform reliable step-by-step reasoning during problem-solving. However, generating accurate and effective textual plans remains challenging due to LLM hallucinations and the high diversity of task-specific questions. To address this, we draw inspiration from human Implicit Cognition (IC), the subconscious process by which decisions are guided by compact, generalized patterns learned from past experiences without requiring explicit verbalization. We propose iCLP, a novel framework that enables LLMs to adaptively generate latent plans (LPs), which are compact encodings of effective reasoning instructions. iCLP first distills explicit plans from existing step-by-step reasoning trajectories. It then learns discrete representations of these plans via a vector-quantized autoencoder coupled with a codebook. Finally, by fine-tuning LLMs on paired latent plans and corresponding reasoning steps, the models learn to perform implicit planning during reasoning. Experimental results on mathematical reasoning and code generation tasks demonstrate that, with iCLP, LLMs can plan in latent space while reasoning in language space. This approach yields significant improvements in both accuracy and efficiency and, crucially, demonstrates strong cross-domain generalization while preserving the interpretability of chain-of-thought reasoning.

大模型推理隐式规划潜在空间可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。