arXiv:2607.03145cs.LGcs.AI2026-07

基于数据几何曲率的自适应采样,提升分类模型训练效率

CuBAS: Information Geometric Curvature-Based Adaptive Sampling for Supervised Classification

论文配图:CuBAS: Information Geometric Curvature-Based Adaptive Sampling for Supervised Classification
图 1 · 摘自论文原文
  • 利用数据分布的曲率特征构建采样权重,识别重要区域
  • 在60多个数据集上显著优于随机和不确定性采样方法
  • 兼顾效率与可解释性,适合数据稀缺场景下的模型训练

训练集的信息量与规模同样重要,但多数采样策略忽略了数据分布的内在几何结构。本文提出CuBAS(曲率自适应采样),基于q-state Potts马尔可夫随机场模型,将标注数据视为统计流形,通过一阶与二阶观测Fisher信息之比估计局部曲率,反映数据分布的几何复杂度。在标注数据上构建k近邻图,从Potts充分统计量推导每个节点的曲率得分。该曲率信号将图划分为低曲率区(平滑同质簇)与高曲率区(集中在决策边界,信息量大)。通过在两类区域中选择样本,CuBAS生成紧凑且信息丰富的训练子集。在超过60个基准数据集上的实证评估表明,其在不同标注预算和分类器架构下均显著优于随机采样与基于不确定性的基线方法。CuBAS计算高效(线性于k-NN边数),理论基础源于统计流形的微分几何,且可通过数据流形的局部形状算子进行解释。

原文摘要 · Abstract (English)

The informativeness of a training set is as consequential as its size, yet most sampling strategies remain agnostic to the intrinsic geometry of the data distribution. We introduce CuBAS (Curvature-Based Adaptive Sampling), an information-geometric framework for adaptive data selection in supervised classification, grounded in the q-state Potts Markov random field (MRF) model. The central insight is that a labeled dataset can be viewed as a statistical manifold, on which local curvature, estimated via the ratio of second to first-order observed Fisher information, faithfully encodes the geometric complexity of the data distribution. We construct a k-nearest-neighbor graph over the labeled data and derive a closed-form curvature score at each vertex from the Potts sufficient statistics. This curvature signal partitions the graph into two complementary regimes: low-curvature regions, corresponding to smooth, homogeneous clusters, and high-curvature regions, concentrated around decision boundaries that are disproportionately informative for classification. By selecting nodes from both regimes, CuBAS constructs compact yet maximally informative training subsets. Empirical evaluation across more than 60 benchmark datasets demonstrates consistent and statistically significant improvements over random sampling and uncertainty-based baselines, across a wide range of labeling budgets and classifier architectures. CuBAS is computationally efficient (linear in the number of k-NN graph edges), theoretically grounded in the differential geometry of statistical manifolds, and interpretable in terms of the local shape operator of the data manifold.

数据采样曲率分析分类优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。