让大模型学会分析提问背后的意图,提升推理准确性。
Improving Language Models with Intentional Analysis
- 引入意图分析机制,在解题时主动识别用户真实意图。
- 在多个基准上超越思维链方法,甚至提升闭源模型表现。
- 适合需要精准理解需求的智能问答与复杂推理场景。
意图是人类沟通与问题解决中的关键认知状态,准确理解问题背后的意图对得出正确答案至关重要。然而,这一重要概念在语言模型快速发展的过程中被严重忽视。本文提出意图分析(Intentional Analysis, IA),在问题求解过程中显式引入意图感知的分析与推理。跨多种基准、模型类型与配置的实验表明,IA 具有显著有效性、鲁棒性与泛化能力。值得注意的是,即使在 GPT-5 和 Claude-Opus-4.6 等顶尖闭源模型上,IA 也持续提升任务性能。此外,IA 不仅在各类设置下优于思维链(CoT),还能与 CoT 协同工作。定性分析与案例研究揭示,其优势源于解决基线方法中常见的意图误解、过早概括和思维惰性等问题。案例还阐明了 IA 的作用机制,揭示其与 CoT 的差异。本研究为未来具备意图分析能力的大模型发展提供了新方向。
原文摘要 · Abstract (English)
Intent, a critical cognitive notion and mental state, is ubiquitous in human communication and problem-solving. Accurately understanding the underlying intent behind questions is imperative to reasoning towards correct answers. However, this significant concept has been largely disregarded in the rapid development of language models (LMs). To unleash the potential of intent and instill it into LMs, this paper introduces Intentional Analysis (IA), which explicitly invokes intent-aware analysis and reasoning during the problem-solving process. Comprehensive experiments across diverse benchmarks, model types, and configurations demonstrate the effectiveness, robustness, and generalizability of IA. Notably, IA consistently improves task performance even on SOTA proprietary models like GPT-5 and Claude-Opus-4.6. Moreover, IA not only outperforms Chain-of-Thought (CoT) across various experimental settings, but it can also synergistically work with CoT reasoning. Further qualitative analysis and case studies reveal that the benefits of IA stem from addressing several weaknesses in baseline methods, such as intent misunderstanding, hasty generalization, and mental laziness. Case studies also provide insights into the mechanisms underlying IA and clarify how it differs from CoT in mitigating these weaknesses. This study sheds light on a promising direction for the development of future LLMs with intentional analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。