让模型自己学会变形状,用几何优化提升表达能力
Learning Geometry: A Framework for Building Adaptive Manifold Models through Metric Optimization
- 通过优化流形上的度量张量,动态调整模型的几何结构
- 在保持拓扑不变的前提下,显著增强模型表达力,防止过拟合
- 适合研究模型可塑性、科学发现与鲁棒表示学习的读者
本文提出一种机器学习新范式,突破传统参数优化的局限。不同于在固定几何空间中寻找最优参数,本工作将模型视为可塑的几何实体,通过优化具有预设拓扑的流形上的度量张量场,动态塑造模型空间的几何结构。为此构建了一个变分框架,其损失函数在数据保真度与流形内在几何复杂度之间取得平衡:前者确保模型有效解释观测数据,后者作为正则项,惩罚过度弯曲或不规则的几何,以鼓励更简洁的模型并防止过拟合。为应对该无限维优化问题的计算挑战,引入基于离散微分几何的方法——将连续流形离散化为三角网格,以边长参数化度量张量,从而利用自动微分工具实现高效优化。理论分析揭示该框架与广义相对论中的爱因斯坦-希尔伯特作用量存在深刻类比,为“数据驱动几何”提供了优雅的物理诠释。进一步论证即使拓扑固定,度量优化仍远超固定几何模型的表达能力。本工作为构建可自主演化几何与拓扑的全动态‘元学习器’奠定了基础,并在科学模型发现与鲁棒表示学习等领域展现出广阔应用前景。
原文摘要 · Abstract (English)
This paper proposes a novel paradigm for machine learning that moves beyond traditional parameter optimization. Unlike conventional approaches that search for optimal parameters within a fixed geometric space, our core idea is to treat the model itself as a malleable geometric entity. Specifically, we optimize the metric tensor field on a manifold with a predefined topology, thereby dynamically shaping the geometric structure of the model space. To achieve this, we construct a variational framework whose loss function carefully balances data fidelity against the intrinsic geometric complexity of the manifold. The former ensures the model effectively explains observed data, while the latter acts as a regularizer, penalizing overly curved or irregular geometries to encourage simpler models and prevent overfitting. To address the computational challenges of this infinite-dimensional optimization problem, we introduce a practical method based on discrete differential geometry: the continuous manifold is discretized into a triangular mesh, and the metric tensor is parameterized by edge lengths, enabling efficient optimization using automatic differentiation tools. Theoretical analysis reveals a profound analogy between our framework and the Einstein-Hilbert action in general relativity, providing an elegant physical interpretation for the concept of "data-driven geometry". We further argue that even with fixed topology, metric optimization offers significantly greater expressive power than models with fixed geometry. This work lays a solid foundation for constructing fully dynamic "meta-learners" capable of autonomously evolving their geometry and topology, and it points to broad application prospects in areas such as scientific model discovery and robust representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。