讲清数值线性代数如何支撑偏微分方程、机器学习等领域的大型计算问题
Advanced Linear Algebra with Applications - Part I (Numerical linear algebra for PDEs, machine learning, and data assimilation)
- 用经典算法解决跨领域的大规模稀疏矩阵问题
- 揭示矩阵向量乘法在现代计算中的核心作用
- 适合数学、计算机与工程背景的研究生阅读
本讲义是硕士级别高级数值线性代数课程的第一部分,旨在不仅呈现经典算法,更阐明该领域为何比上一代更为关键。数值线性代数最初伴随偏微分方程的数值求解而发展,长期依赖大稀疏系统。如今,网络节点排序、气象观测同化、大规模噪声数据建模也产生同类问题:规模过大无法直接分解,具有结构特征,仅可通过矩阵-向量乘法访问。令人惊讶的是,少量核心思想可贯穿所有场景。每章先讲解标准主题,再将其应用于原领域之外。内容涵盖范数、分解、条件数与浮点运算;来自有限差分、图结构及机器学习的稀疏矩阵;定常迭代与平滑性质;共轭梯度与Lanczos方法,含谱聚类与早停正则化;Arnoldi与GMRES,结合PageRank与大规模最小二乘;最后讨论预条件化、Schwarz域分解与多网格方法。假设已修过线性代数基础课。每节末有要点总结,每章附习题(部分来自往届考试)。配套Python代码复现数值示例。
原文摘要 · Abstract (English)
These lecture notes form the first part of a master's-level course on advanced numerical linear algebra. Their aim is not only to present the classical algorithms, but to show why the subject has become considerably more central than it was a generation ago. Numerical linear algebra grew up alongside the numerical solution of partial differential equations, and for a long time that is where its large sparse systems came from. Ranking the nodes of a network, assimilating observations into a weather forecast, and fitting a model to a large noisy data set now lead to problems of the same kind: too large to factorise, structured, and accessible only through matrix-vector products. Strikingly few ideas are needed for all of them. Each chapter therefore develops a standard topic and then puts it to work outside its original setting. We treat norms, factorisations, conditioning and floating-point arithmetic; sparse matrices arising from finite differences, from graphs and from machine learning; stationary iterations and the smoothing property; the conjugate gradient and Lanczos methods, with spectral clustering and regularisation by early stopping; Arnoldi and GMRES, with PageRank and large least squares; and finally preconditioning, Schwarz domain decomposition and multigrid. We assume a first course in linear algebra. Every section closes with a summary of what should be retained and every chapter with exercises, several drawn from past examinations. Accompanying Python code reproduces the numerical illustrations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。