arXiv:2508.00197cs.CVcs.LG2025-08

提出分层图谱与骨架乘积,构建可扩展的层次化模型架构

Graph Lineages and Skeletal Graph Products

  • 定义分层图谱,通过双射连接层级,实现指数级增长
  • 设计骨架算子,使图运算在保持效率的同时支持多尺度结构
  • 适用于深度网络与多重网格方法,支持局部搜索与优化

图及其随层级递增的序列可用于描述机器学习与计算科学中数学模型的结构。本文定义了按层级编号有序的结构化图‘谱系’,其顶点与边数随层级呈指数增长;相邻层级间由二分图连接,类似多重网格方法,约束各层级间的矩阵关系;利用延拓映射,可定义不同层级图之间的过程衍生距离度量;进一步引入‘分级图’类别,由此推导出标准代数图运算(如叉积、盒积、不相交和、函数类型)的低成本‘骨架’变体,适用于分级图及分层图谱;这些骨架二元算子具有与标准形式相似但不完全相同的代数与范畴性质;分层图谱及其骨架乘积可逼近连续极限对象。还提出了两类空间高效的单目算子:加厚操作生成多尺度图谱,升格操作构建搜索前沿图谱,可用于推广自适应网格与定义‘骨架’函数。最终建立了一个关于分级图与分层图谱的代数类型理论。该方法适用于定义层次化模型架构(‘分层结构’)及在其上进行局部采样、搜索或优化。已应用于深度神经网络(包括视觉与特征尺度空间)和多重网格数值方法。

原文摘要 · Abstract (English)

Graphs, and sequences of growing graphs, can be used to specify the architecture of mathematical models in many fields including machine learning and computational science. Here we define structured graph "lineages" (ordered by level number) that grow in a hierarchical fashion, so that: (1) the number of graph vertices and edges increases exponentially in level number; (2) bipartite graphs connect successive levels within a graph lineage and, as in multigrid methods, can constrain matrices relating successive levels; (3) using prolongation maps within a graph lineage, process-derived distance measures between graphs at successive levels can be defined; (4) a category of "graded graphs" can be defined, and using it low-cost "skeletal" variants of standard algebraic graph operations and type constructors (cross product, box product, disjoint sum, and function types) can be derived for graded graphs and hence hierarchical graph lineages; (5) these skeletal binary operators have similar but not identical algebraic and category-theoretic properties to their standard counterparts; (6) graph lineages and their skeletal product constructors can approach continuum limit objects. Additional space-efficient unary operators on graded graphs are also derived: thickening, which creates a graph lineage of multiscale graphs, and escalation to a graph lineage of search frontiers (useful as a generalization of adaptive grids and in defining "skeletal" functions). The result is an algebraic type theory for graded graphs and (hierarchical) graph lineages. The approach is expected to be well suited to defining hierarchical model architectures - "hierarchitectures" - and local sampling, search, or optimization algorithms on them. We demonstrate such application to deep neural networks (including visual and feature scale spaces) and to multigrid numerical methods.

图神经网络分层结构代数结构多尺度建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。