arXiv:2409.12805stat.MLcs.LG2024-09被引 8

用量子认知方法估计数据内在维度,抗噪能力强。

Robust estimation of the intrinsic dimension of data sets with quantum cognition machine learning

  • 将数据点映射为量子态,构建带量子度量的点云。
  • 通过谱隙位置准确估计数据内在维度,噪声下结果稳定。
  • 适合处理含未知噪声的真实数据,如人脸、手写数字等。

我们提出一种基于量子认知机器学习的新数据表示方法,并将其应用于流形学习,特别是数据集内在维度的估计。思路是将每个数据点表示为量子态,编码该点的局部特性及其与整体数据的关系。受量子几何启发,从这些量子态构建出带有量子度量的点云。该度量表现出一个谱隙,其位置对应于数据的内在维度。所提出的估计器基于该谱隙的检测。在合成流形基准测试中,我们的估计对点级高斯噪声具有鲁棒性,而当前最先进的估计器往往将噪声伪影误判为额外的‘影子维度’,导致高估。这在处理不可避免受未知噪声影响的真实数据时是一个显著优势。我们在ISOMAP人脸数据库、MNIST和威斯康星州乳腺癌数据集上验证了该方法的应用性和鲁棒性。

原文摘要 · Abstract (English)

We propose a new data representation method based on Quantum Cognition Machine Learning and apply it to manifold learning, specifically to the estimation of intrinsic dimension of data sets. The idea is to learn a representation of each data point as a quantum state, encoding both local properties of the point as well as its relation with the entire data. Inspired by ideas from quantum geometry, we then construct from the quantum states a point cloud equipped with a quantum metric. The metric exhibits a spectral gap whose location corresponds to the intrinsic dimension of the data. The proposed estimator is based on the detection of this spectral gap. When tested on synthetic manifold benchmarks, our estimates are shown to be robust with respect to the introduction of point-wise Gaussian noise. This is in contrast to current state-of-the-art estimators, which tend to attribute artificial ``shadow dimensions'' to noise artifacts, leading to overestimates. This is a significant advantage when dealing with real data sets, which are inevitably affected by unknown levels of noise. We show the applicability and robustness of our method on real data, by testing it on the ISOMAP face database, MNIST, and the Wisconsin Breast Cancer Dataset.

流形学习量子机器学习维度估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。