arXiv:2410.14539stat.MLcs.LG2024-10

用扩散模型做流形回归,自动学习数据结构,提升预测效果。

Diffusion-based Semi-supervised Spectral Algorithm for Regression on Manifolds

  • 基于热核的图拉普拉斯近似,自适应构建数据局部结构。
  • 半监督框架利用未标记数据,收敛率仅依赖流形内在维数。
  • 无需预设流形信息,适合高维低秩数据建模。

我们提出一种新型基于扩散的谱算法,用于高维数据上的回归分析,尤其适用于嵌入在低维流形中的数据。传统谱方法常因依赖预设核函数而失效,难以捕捉流形数据的复杂结构。本方法通过图拉普拉斯逼近,利用热核的局部估计特性,实现自适应、数据驱动的建模。其半监督框架可充分利用未标记数据,帮助挖掘数据流形的谱与曲率特征,提升理解深度。算法完全在数据内在流形结构中运行,无需预先设定流形信息。我们提供了收敛性分析,结果表明算法收敛速度仅取决于底层流形的内在维度,避免了高环境维度带来的维数灾难问题。

原文摘要 · Abstract (English)

We introduce a novel diffusion-based spectral algorithm to tackle regression analysis on high-dimensional data, particularly data embedded within lower-dimensional manifolds. Traditional spectral algorithms often fall short in such contexts, primarily due to the reliance on predetermined kernel functions, which inadequately address the complex structures inherent in manifold-based data. By employing graph Laplacian approximation, our method uses the local estimation property of heat kernel, offering an adaptive, data-driven approach to overcome this obstacle. Another distinct advantage of our algorithm lies in its semi-supervised learning framework, enabling it to fully use the additional unlabeled data. This ability enhances the performance by allowing the algorithm to dig the spectrum and curvature of the data manifold, providing a more comprehensive understanding of the dataset. Moreover, our algorithm performs in an entirely data-driven manner, operating directly within the intrinsic manifold structure of the data, without requiring any predefined manifold information. We provide a convergence analysis of our algorithm. Our findings reveal that the algorithm achieves a convergence rate that depends solely on the intrinsic dimension of the underlying manifold, thereby avoiding the curse of dimensionality associated with the higher ambient dimension.

流形学习半监督回归分析扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。