用量子电路实现结构感知的降维,压缩数据并提升混合模型效率
Dimension reduction with structure-aware quantum circuits for hybrid machine learning
- 基于张量网络分解确定秩k,设计结构感知量子电路进行降维
- 在scikit-learn数据集上实现有效k-秩近似,输入维度指数级压缩
- 适合研究量子-经典混合模型、数据压缩与低秩表示的学者
向量的施密特分解可视为奇异值分解(SVD)的向量形式。通过递归对所有子系统应用SVD,可将向量表示为二维向量张量积的线性组合。仅保留前k个主项即可获得该向量的k-秩近似,从而保留主要信息并去除噪声,类似SVD去噪。本文提出,基于均值向量张量网络分解确定的秩k值设计量子电路,可有效逼近整个数据集的降维表示。随后将该量子电路与经典神经网络头结合,构建混合机器学习模型。由于该量子电路对2^n维向量输出n维概率分布,实现了输入的指数级压缩,有望显著减少大规模模型的可训练参数量。实验使用Python scikit-learn模块提供的数据集,结果验证了该量子电路能成功压缩数据,为后续经典处理组件提供有效的k-秩近似。
原文摘要 · Abstract (English)
Schmidt decomposition of a vector can be understood as writing the singular value decomposition (SVD) in vector form. A vector can be written as a linear combination of tensor product of two dimensional vectors by recursively applying Schmidt decompositions via SVD to all subsystems. Given a vector expressed as a linear combination of tensor products, using only the $k$ principal terms yields a $k$-rank approximation of the vector. Therefore, writing a vector in this reduced form allows to retain most important parts of the vector while removing small noises from it, analogous to SVD-based denoising. In this paper, we show that quantum circuits designed based on a value $k$ (determined from the tensor network decomposition of the mean vector of the training sample) can approximate the reduced-form representations of entire datasets. We then employ this circuit ansatz with a classical neural network head to construct a hybrid machine learning model. Since the output of the quantum circuit for an $2^n$ dimensional vector is an $n$ dimensional probability vector, this provides an exponential compression of the input and potentially can reduce the number of learnable parameters for training large-scale models. We use datasets provided in the Python scikit-learn module for the experiments. The results confirm the quantum circuit is able to compress data successfully to provide effective $k$-rank approximations to the classical processing component.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。