将点数据建模为流形上的点,通过图神经网络实现半监督分类。
Graph Semi-Supervised Learning for Point Classification on Data Manifolds
- 用变分自编码器学习数据在低维流形上的嵌入坐标。
- 构建高斯加权图后,使用GNN在图上完成半监督分类任务。
- 理论证明分类误差随图规模增大而缩小,适合小样本图像分类场景。
我们提出一种针对数据流形上点分类任务的图半监督学习框架。基于流形假设,将数据视为从低维流形 $/mathcal{M} \subset \mathbb{R}^F$ 中采样得到的点。通过无监督方式训练变分自编码器(VAE),其编码器将数据映射到嵌入空间中的坐标。在嵌入空间中构建几何图,边权重采用与距离成反比的高斯核,将点分类问题转化为图上的半监督节点分类任务。该任务由图神经网络(GNN)求解。主要贡献在于对该数据-流形-图管道的统计泛化性质进行理论分析:在均匀采样条件下,半监督任务的泛化差距随图规模增大而减小,直至达到GNN训练误差。通过在训练过程中定期重采样略大图的策略,进一步降低泛化差距,使其渐近趋于零。最后,在图像分类基准上进行数值实验,验证了方法的有效性。
原文摘要 · Abstract (English)
We propose a graph semi-supervised learning framework for classification tasks on data manifolds. Motivated by the manifold hypothesis, we model data as points sampled from a low-dimensional manifold $\mathcal{M} \subset \mathbb{R}^F$. The manifold is approximated in an unsupervised manner using a variational autoencoder (VAE), where the trained encoder maps data to embeddings that represent their coordinates in $\mathbb{R}^F$. A geometric graph is constructed with Gaussian-weighted edges inversely proportional to distances in the embedding space, transforming the point classification problem into a semi-supervised node classification task on the graph. This task is solved using a graph neural network (GNN). Our main contribution is a theoretical analysis of the statistical generalization properties of this data-to-manifold-to-graph pipeline. We show that, under uniform sampling from $\mathcal{M}$, the generalization gap of the semi-supervised task diminishes with increasing graph size, up to the GNN training error. Leveraging a training procedure which resamples a slightly larger graph at regular intervals during training, we then show that the generalization gap can be reduced even further, vanishing asymptotically. Finally, we validate our findings with numerical experiments on image classification benchmarks, demonstrating the empirical effectiveness of our approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。