在双曲空间和正定矩阵流形上构建1-利普希茨神经网络,提升模型鲁棒性。
1-Lipschitz Neural Networks on Hadamard Manifolds

- 基于布塞曼函数设计保持几何结构的1-利普希茨层
- 在庞加莱圆盘上对超球扰动具有鲁棒分类能力
- 适用于双曲数据或正定矩阵建模任务的稳定网络架构
控制神经网络的利普希茨常数是提升其鲁棒性和稳定性的常用方法。现有约束策略多针对欧氏空间设计。本文在哈达玛德流形上构建并分析一类1-利普希茨神经网络。所提层为梯度下降型,具有1-利普希茨性质和准α-牢固非扩张性。核心构件为布塞曼函数,利用布塞曼梯度流的性质设计保持几何结构的1-利普希茨层。给出双曲空间及对称正定(SPD)矩阵流形的显式构造与实例。在两个数值实验中测试:庞加莱圆盘上的鲁棒分类与掩码-威沙特协方差重构。在庞加莱圆盘上,所提网络在超球扰动下表现稳健;在SPD流形上,训练了SPD值去噪器,并作为插件式先验用于掩码-威沙特协方差重建问题,结果优于静态、仅数据及对数-欧氏去噪基线,且实证验证了收敛性。
原文摘要 · Abstract (English)
Controlling the Lipschitz constant of a neural network is a standard way to promote robustness and stability. Most existing constraining strategies are designed for Euclidean spaces. In this work, we construct and analyze a class of 1-Lipschitz neural networks on Hadamard manifolds. Our layers are of gradient-descent type, $1$-Lipschitz, and quasi-$α$-firmly nonexpansive. The core building blocks of the proposed architecture are Busemann functions, and we exploit the properties of Busemann gradient flows to design $1$-Lipschitz geometry-preserving layers. We provide explicit constructions and examples for hyperbolic manifolds and the manifold of symmetric positive definite (SPD) matrices. We test the proposed architecture in two numerical experiments: robust classification on the Poincaré disk and masked-Wishart covariance reconstruction. On the Poincaré disk, the proposed networks yield robust classifiers under hyperbolic perturbations. On the SPD manifold, we train SPD-valued denoisers and adopt them as a Plug-and-Play prior for a masked-Wishart covariance reconstruction problem. We show improved results from the nonexpansive denoiser over static, data-only, and Log-Euclidean denoising baselines, and empirically test its convergence properties.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。