arXiv:2506.13192cs.CLcs.AI2025-06被引 1

让大模型打破思维定式,生成更创意多样的回答。

Breaking Thought Patterns: A Multi-Dimensional Reasoning Framework for LLMs

  • 用多步推理+专家分工+维度调整,打破传统模型僵化思路。
  • 在多项任务中提升完成率、创意性和流畅度,表现优于旧模型。
  • 适合需要创造性解题的复杂任务研究者或开发者使用。

大型语言模型常受限于僵化的推理过程,难以生成富有创意和多样性的回应。为此,本文提出名为LADDER的新框架,融合链式思考(CoT)推理、专家混合(MoE)模型及多维上/下采样策略,突破传统大模型的局限。首先,CoT推理引导模型进行多步逻辑推演,拓展语义空间,打破思维定势;其次,MoE将推理任务分配至多个专家模块,各专注特定子任务;最后,通过降维处理将推理输出映射回低维语义空间,生成更精准且富创意的回答。大量实验表明,LADDER在多项任务中显著提升任务完成度、创意性与流畅性,生成的回应兼具创新性与连贯性,优于传统模型。消融实验证明CoT与MoE在增强推理能力与创意产出中起关键作用。本工作推动了更具灵活性与创造力的大模型发展,使其能够应对复杂与新颖任务。

原文摘要 · Abstract (English)

Large language models (LLMs) are often constrained by rigid reasoning processes, limiting their ability to generate creative and diverse responses. To address this, a novel framework called LADDER is proposed, combining Chain-of-Thought (CoT) reasoning, Mixture of Experts (MoE) models, and multi-dimensional up/down-sampling strategies which breaks the limitations of traditional LLMs. First, CoT reasoning guides the model through multi-step logical reasoning, expanding the semantic space and breaking the rigidity of thought. Next, MoE distributes the reasoning tasks across multiple expert modules, each focusing on specific sub-tasks. Finally, dimensionality reduction maps the reasoning outputs back to a lower-dimensional semantic space, yielding more precise and creative responses. Extensive experiments across multiple tasks demonstrate that LADDER significantly improves task completion, creativity, and fluency, generating innovative and coherent responses that outperform traditional models. Ablation studies reveal the critical roles of CoT and MoE in enhancing reasoning abilities and creative output. This work contributes to the development of more flexible and creative LLMs, capable of addressing complex and novel tasks.

大模型思维创新推理框架创意生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。