arXiv:2507.08255cs.LGcs.AI2025-07被引 2

用量子电路提升大模型对缺失数据的修复能力,效果优于传统方法。

Quantum-Accelerated Neural Imputation with Large Language Models (LLMs)

  • 用量子电路替代传统嵌入,学习更丰富的数据表示
  • 数值特征RMSE降15.2%,分类F1-Score提升8.7%
  • 适合处理含文本、数值、类别混合特征的复杂缺失数据

缺失数据是现实数据集中的关键挑战,严重降低机器学习模型性能。尽管大语言模型(LLM)在表格数据填补方面表现出色,如UnIMP框架,但其依赖经典嵌入方法,难以捕捉复杂非线性相关性,尤其在包含数值、类别和文本特征的混合数据场景中。本文提出Quantum-UnIMP,将浅层量子电路融入基于LLM的填补架构。核心创新在于用即时量子多项式(IQP)电路生成的量子特征映射替代传统经典输入嵌入,利用量子叠加与纠缠特性,学习更具表现力的数据表示,提升对复杂缺失模式的恢复能力。在基准混合类型数据集上的实验表明,Quantum-UnIMP相比先进经典与基于LLM的方法,数值特征的均方根误差(RMSE)降低15.2%,类别特征的F1得分提升8.7%。这些结果凸显了量子增强表示在复杂数据填补任务中的巨大潜力,即使在近中期量子硬件条件下亦然。

原文摘要 · Abstract (English)

Missing data presents a critical challenge in real-world datasets, significantly degrading the performance of machine learning models. While Large Language Models (LLMs) have recently demonstrated remarkable capabilities in tabular data imputation, exemplified by frameworks like UnIMP, their reliance on classical embedding methods often limits their ability to capture complex, non-linear correlations, particularly in mixed-type data scenarios encompassing numerical, categorical, and textual features. This paper introduces Quantum-UnIMP, a novel framework that integrates shallow quantum circuits into an LLM-based imputation architecture. Our core innovation lies in replacing conventional classical input embeddings with quantum feature maps generated by an Instantaneous Quantum Polynomial (IQP) circuit. This approach enables the model to leverage quantum phenomena such as superposition and entanglement, thereby learning richer, more expressive representations of data and enhancing the recovery of intricate missingness patterns. Our experiments on benchmark mixed-type datasets demonstrate that Quantum-UnIMP reduces imputation error by up to 15.2% for numerical features (RMSE) and improves classification accuracy by 8.7% for categorical features (F1-Score) compared to state-of-the-art classical and LLM-based methods. These compelling results underscore the profound potential of quantum-enhanced representations for complex data imputation tasks, even with near-term quantum hardware.

量子计算数据填补大模型混合数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。