arXiv:2502.15476math.ATcs.CG2025-02被引 24

用层论连接几何与深度学习,揭示模型盲区

Sheaf theory: from deep geometry to deep learning

  • 将层理论从几何延伸至深度学习,构建通用数学框架
  • 提出新算法计算任意有限偏序集上的层上同调
  • 适合对数学基础与机器学习交叉感兴趣的读者

本文综述了层论在深度学习、数据科学及计算机科学中的应用。正文以友好方式介绍应用与计算层论,适合数学基础较弱的读者。阐述了理论研究者与实践者共有的直觉与动机,连接经典数学理论与信号处理和深度学习中的最新实现。我们发现,通常被视为细胞层特有概念的许多内容可推广至任意偏序集,为方法泛化开辟新路径,并针对此提出一种计算任意有限偏序集上层上同调的新算法。通过融合经典理论与近期应用,本文揭示当前机器学习实践中的一些盲点。最后列出一系列我们认为在数学上有洞察力且实践上具指导意义的问题。附录提供自包含的严格数学导引,涵盖图表、层定义、导出函子、高阶上同调、层拉普拉斯算子、层扩散及其相互关联。

原文摘要 · Abstract (English)

This paper provides an overview of the applications of sheaf theory in deep learning, data science, and computer science in general. The primary text of this work serves as a friendly introduction to applied and computational sheaf theory accessible to those with modest mathematical familiarity. We describe intuitions and motivations underlying sheaf theory shared by both theoretical researchers and practitioners, bridging classical mathematical theory and its more recent implementations within signal processing and deep learning. We observe that most notions commonly considered specific to cellular sheaves translate to sheaves on arbitrary posets, providing an interesting avenue for further generalization of these methods in applications, and we present a new algorithm to compute sheaf cohomology on arbitrary finite posets in response. By integrating classical theory with recent applications, this work reveals certain blind spots in current machine learning practices. We conclude with a list of problems related to sheaf-theoretic applications that we find mathematically insightful and practically instructive to solve. To ensure the exposition of sheaf theory is self-contained, a rigorous mathematical introduction is provided in appendices which moves from an introduction of diagrams and sheaves to the definition of derived functors, higher order cohomology, sheaf Laplacians, sheaf diffusion, and interconnections of these subjects therein.

层论机器学习数学基础深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。