大模型如何解决数学与优化问题,从推理到实际应用的全景综述。
A Survey on Mathematical Reasoning and Optimization with Large Language Models
- 梳理大模型在数学推理与优化中的演进路径与核心技术。
- 展示大模型在定理证明、约束生成与启发式搜索中的实用能力。
- 适合关注AI求解复杂问题的科研与工程人员阅读。
数学推理与优化是人工智能和计算求解的核心。近年来,大语言模型(LLMs)在驱动数学推理、定理证明与优化技术方面取得显著进展。本文综述了人工智能中数学求解的发展历程,涵盖从早期统计学习到现代深度学习与基于Transformer的方法。重点分析预训练语言模型及大模型在算术运算、复杂推理、定理证明与结构化符号计算方面的表现。特别关注大模型与优化控制框架(如混合整数规划、线性二次控制、多智能体优化)的融合,包括问题建模、约束生成与启发式搜索支持,实现理论推理与实际应用的衔接。同时探讨链式思维、指令微调与工具增强等提升方法。尽管进步显著,大模型仍面临数值精度、逻辑一致性与证明验证等挑战。新兴趋势如神经-符号混合推理、结构化提示工程与多步自纠错正致力于突破限制。未来研究应聚焦可解释性、领域求解器集成与决策鲁棒性。本综述全面梳理了大模型在数学推理与优化领域的现状与发展方向,应用于工程、金融与科研等多个领域。
原文摘要 · Abstract (English)
Mathematical reasoning and optimization are fundamental to artificial intelligence and computational problem-solving. Recent advancements in Large Language Models (LLMs) have significantly improved AI-driven mathematical reasoning, theorem proving, and optimization techniques. This survey explores the evolution of mathematical problem-solving in AI, from early statistical learning approaches to modern deep learning and transformer-based methodologies. We review the capabilities of pretrained language models and LLMs in performing arithmetic operations, complex reasoning, theorem proving, and structured symbolic computation. A key focus is on how LLMs integrate with optimization and control frameworks, including mixed-integer programming, linear quadratic control, and multi-agent optimization strategies. We examine how LLMs assist in problem formulation, constraint generation, and heuristic search, bridging theoretical reasoning with practical applications. We also discuss enhancement techniques such as Chain-of-Thought reasoning, instruction tuning, and tool-augmented methods that improve LLM's problem-solving performance. Despite their progress, LLMs face challenges in numerical precision, logical consistency, and proof verification. Emerging trends such as hybrid neural-symbolic reasoning, structured prompt engineering, and multi-step self-correction aim to overcome these limitations. Future research should focus on interpretability, integration with domain-specific solvers, and improving the robustness of AI-driven decision-making. This survey offers a comprehensive review of the current landscape and future directions of mathematical reasoning and optimization with LLMs, with applications across engineering, finance, and scientific research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。