通过子采样提升因子分解机退火的探索与利用平衡能力
Subsampling Factorization Machine Annealing
- 用子数据集替代全数据训练因子分解机,降低计算开销
- 在速度和精度上均优于原算法,且可进一步提升性能
- 适合大规模黑箱优化问题,具备良好可扩展性
量子计算与机器学习是学术界和工业界广泛研究的前沿技术。二者结合有望解决科学与工程中的复杂问题,如组合优化,并加速下一代技术的研发。本文提出一种改进的因子分解机退火算法(SFMA),通过从全数据集中子采样生成子数据集进行训练,而非使用完整数据集。这种概率性训练过程增强了算法在解空间中的探索能力,实现了良好的探索-利用平衡。数值基准测试表明,SFMA在速度和准确性上均优于原算法(FMA)。此外,通过依次使用大小不同的两个子数据集(后者的规模显著小于前者),可进一步提升探索性能并大幅降低计算成本,即使面对大规模问题也能高效运行。这些结果验证了SFMA在特定类别的大规模黑箱优化问题中具有有效性和可扩展性。
原文摘要 · Abstract (English)
Quantum computing and machine learning are state-of-the-art technologies that have been investigated intensively in both academia and industry. The hybrid technology of these two ingredients is expected to be a powerful tool to solve complex problems in many branches of science and engineering such as combinatorial optimization problems and accelerate the creation of next-generation technologies. In this work, we develop an algorithm to solve a black-box optimization problem by improving Factorization Machine Annealing (FMA) such that the training of a machine learning model called Factorization Machine is performed not by a full dataset but by a subdataset that is sampled from a full dataset: Subsampling Factorization Machine Annealing (SFMA). According to such a probabilistic training process, the performance of FMA on exploring a solution space gets enhanced. As a result, SFMA exhibits balanced performance of exploration and exploitation, which we call exploitation-exploration functionality. We conduct numerical benchmarking tests to compare the performance of SFMA with that of FMA. Consequently, SFMA certainly exhibits the exploration-exploitation functionality and outperforms FMA in speed and accuracy. In addition, the performance of SFMA can be further improved by sequentially using two subsampling datasets with different sizes such that the size of the latter dataset is substantially smaller than the former. Such a substantial reduction not only enhances the exploration performance of SFMA but also enables us to run it with correspondingly low computational cost even for a large-scale problem. These results indicate the effectiveness of SFMA in a certain class of black-box optimization problems of significant size: the potential scalability of SFMA in solving large-scale problems with correspondingly low computational cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。