arXiv:2602.02739cs.LGcs.AI2026-02

用拓扑结构稳定地剪裁数据,提升模型鲁棒性和跨架构迁移能力

TopoPrune: Robust Data Pruning via Unified Latent Space Topology

  • 通过双尺度拓扑分析,捕捉数据内在结构并构建低维嵌入
  • 在90%剪裁率下仍保持高精度,对特征噪声和架构变化均稳定
  • 适合需要高鲁棒性数据剪裁的场景,如预训练模型微调

几何数据剪裁方法虽能利用预训练模型,但本质不稳定,依赖外在几何结构,对潜在空间扰动高度敏感,导致跨架构迁移或存在特征噪声时性能下降。本文提出TopoPrune框架,通过拓扑特性捕捉数据的稳定内在结构。该方法在两个尺度上运作:(1) 利用拓扑感知流形逼近建立数据集的全局低维嵌入;(2) 采用可微持久同调进行局部拓扑优化,按样本结构复杂度排序。实验证明,统一的双尺度拓扑方法在高剪裁率(如90%)下仍保持高准确率与高精度。此外,得益于拓扑的固有稳定性,TopoPrune对潜变量特征扰动具有极强鲁棒性,并在不同网络架构间表现出优异迁移能力。本研究为构建稳定、可解释的拓扑驱动数据高效学习框架提供了新路径。

原文摘要 · Abstract (English)

Geometric data pruning methods, while practical for leveraging pretrained models, are fundamentally unstable. Their reliance on extrinsic geometry renders them highly sensitive to latent space perturbations, causing performance to degrade during cross-architecture transfer or in the presence of feature noise. We introduce TopoPrune, a framework which resolves this challenge by leveraging topology to capture the stable, intrinsic structure of data. TopoPrune operates at two scales, (1) utilizing a topology-aware manifold approximation to establish a global low-dimensional embedding of the dataset. Subsequently, (2) it employs differentiable persistent homology to perform a local topological optimization on the manifold embeddings, ranking samples by their structural complexity. We demonstrate that our unified dual-scale topological approach ensures high accuracy and precision, particularly at significant dataset pruning rates (e.g., 90%). Furthermore, through the inherent stability properties of topology, TopoPrune is (a) exceptionally robust to noise perturbations of latent feature embeddings and (b) demonstrates superior transferability across diverse network architectures. This study demonstrates a promising avenue towards stable and principled topology-based frameworks for robust data-efficient learning.

数据剪裁拓扑学习鲁棒性低秩表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。