arXiv:2501.14641cs.LGmath.AT2025-01ICLR被引 2

提出可扩展的拓扑正则化方法,解决传统方法计算慢、训练不稳问题。

Towards Scalable Topological Regularizers

  • 基于小样本子集的持久同调计算,实现高效拓扑特征捕捉
  • 在形状匹配、图像生成等任务中显著提升性能,支持大规模应用
  • 首次实现平滑密度下的连续梯度,适合对抗训练等敏感场景

潜在空间匹配是对抗攻击与防御、域自适应和生成建模等任务的关键。常用概率测度差异度量如Wasserstein和最大均值差异计算成本高,且难以捕捉分布的几何与拓扑特征。持久同调作为拓扑数据分析工具,可量化点云的多尺度拓扑结构,已被用作学习任务中的拓扑正则化器,但其计算开销大且梯度不连续,导致训练不稳定。本文提出基于大量小样本子集计算持久同调的主持久度量,作为拓扑正则化器,并实现并行化的GPU版本,证明在光滑密度下梯度连续。实验表明该方法在形状匹配、图像生成和半监督学习任务中有效,为拓扑特征的可扩展正则化开辟了新路径。

原文摘要 · Abstract (English)

Latent space matching, which consists of matching distributions of features in latent space, is a crucial component for tasks such as adversarial attacks and defenses, domain adaptation, and generative modelling. Metrics for probability measures, such as Wasserstein and maximum mean discrepancy, are commonly used to quantify the differences between such distributions. However, these are often costly to compute, or do not appropriately take the geometric and topological features of the distributions into consideration. Persistent homology is a tool from topological data analysis which quantifies the multi-scale topological structure of point clouds, and has recently been used as a topological regularizer in learning tasks. However, computation costs preclude larger scale computations, and discontinuities in the gradient lead to unstable training behavior such as in adversarial tasks. We propose the use of principal persistence measures, based on computing the persistent homology of a large number of small subsamples, as a topological regularizer. We provide a parallelized GPU implementation of this regularizer, and prove that gradients are continuous for smooth densities. Furthermore, we demonstrate the efficacy of this regularizer on shape matching, image generation, and semi-supervised learning tasks, opening the door towards a scalable regularizer for topological features.

拓扑正则化持久同调生成模型可扩展性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。