arXiv:2503.21686quant-phcs.LG2025-03AAAI被引 4

用量子电路实现注意力机制,高效计算分子基态能量

Molecular Quantum Transformer

论文配图:Molecular Quantum Transformer
图 1 · 摘自论文原文
  • 用量子电路替代经典注意力,直接处理分子构型数据
  • 在H2、LiH等分子上比经典Transformer更准确计算基态能量
  • 可预训练后快速适配新分子,适合复杂分子系统研究

Transformer模型虽在多种AI任务中表现卓越,但存在计算成本高、内存占用大的问题。尽管尝试将量子计算引入Transformer设计,但在处理经典数据时仍进展有限。随着量子机器学习在量子化学领域的兴起,我们提出分子量子Transformer(MQT),用于建模分子量子系统的相互作用。通过量子电路实现分子构型上的注意力机制,MQT能高效计算所有构型的基态能量。数值实验表明,在计算H2、LiH、BeH2和H4的基态能量时,MQT优于经典Transformer,凸显了量子效应在Transformer结构中的潜力。此外,其在多样分子数据上的预训练能力,使新分子的学习更加高效,仅需少量额外工作即可扩展至复杂分子系统。该方法为估算基态能量提供了新路径,推动了量子化学与材料科学的发展。

原文摘要 · Abstract (English)

The Transformer model, renowned for its powerful attention mechanism, has achieved state-of-the-art performance in various artificial intelligence tasks but faces challenges such as high computational cost and memory usage. Researchers are exploring quantum computing to enhance the Transformer's design, though it still shows limited success with classical data. With a growing focus on leveraging quantum machine learning for quantum data, particularly in quantum chemistry, we propose the Molecular Quantum Transformer (MQT) for modeling interactions in molecular quantum systems. By utilizing quantum circuits to implement the attention mechanism on the molecular configurations, MQT can efficiently calculate ground-state energies for all configurations. Numerical demonstrations show that in calculating ground-state energies for H2, LiH, BeH2, and H4, MQT outperforms the classical Transformer, highlighting the promise of quantum effects in Transformer structures. Furthermore, its pretraining capability on diverse molecular data facilitates the efficient learning of new molecules, extending its applicability to complex molecular systems with minimal additional effort. Our method offers an alternative to existing quantum algorithms for estimating ground-state energies, opening new avenues in quantum chemistry and materials science.

量子计算分子模拟Transformer量子机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。