arXiv:2607.10057quant-phcs.AI2026-07被引 1

评估AI看量子电路图生成代码的性价比,发现中等模型最划算。

Quantum Circuit Vision: Cost-Aware Evaluation of Visual AI Agents for Quantum Code Generation

  • 构建132个量子电路基准测试集,支持代码执行与保真度验证。
  • 中等模型成本仅强模型18%,准确率91%且差异不显著。
  • 模型级联路由比优化提示更有效,可降本62%提升效率。

AI能否理解量子电路图并生成可验证的可执行代码?我们提出量子电路视觉评估框架(QCV),构建涵盖13类、1至10量子比特的132个电路基准,包含亚马逊布雷特(Amazon Braket)可执行代码和酉保真度验证。对三款前沿克劳德系列模型在不同能力-成本层级进行五次重复测试,发现中端模型(Sonnet 4.6,1.30倍凭证)在成本-精度权衡上最优:核心子集通过率达91%,单次调用成本仅为最强模型(Opus 4.6)的18%,其准确率优势无统计显著性(配对t检验,p=0.083)。逻辑回归显示电路深度是失败主因(p<0.001),而非量子比特数;链式思考提示无显著效果(所有p>0.18,n=5),表明结构耦合图依赖模式识别而非显式推理。我们提出级联路由策略(低成本→高成本模型),实现84%准确率,成本仅为单一模型的38%,证明模型调度比提示工程更具成本控制优势。数据集(QCV-Dataset,132电路,5模态,1,931文件)已发布于Hugging Face Hub,评估代码、成本日志与验证脚本均开源,确保可复现性。

原文摘要 · Abstract (English)

Can AI agents visually comprehend quantum circuit diagrams and generate verified executable code--and at what cost? We present Quantum Circuit Vision, a cost-aware evaluation framework for multimodal AI agents on quantum circuit visual understanding. We construct a 132-circuit benchmark spanning 13 categories ($1$--$10$ qubits) with executable Amazon Braket code and unitary-fidelity verification. Evaluating three frontier Claude-family models at different capability-cost tiers with $n=5$ repeated trials, we find that the mid-tier model (Sonnet 4.6, $1.30\times$ credits) offers the most favorable balance on the cost-accuracy frontier: 91% pass rate on the core subset at 18% of the per-call cost of the strongest model (Opus 4.6), whose accuracy advantage is not statistically significant (paired $t$: $p=0.083$). Logistic regression confirms that circuit depth--not qubit count--is the primary predictor of failure ($p<0.001$). Chain-of-thought prompting shows no statistically significant effect (all $p>0.18$, $n=5$), suggesting that visual pattern recognition outweighs explicit reasoning strategy for structurally coupled diagrams. We propose a cascade routing strategy (cheap $\rightarrow$ expensive models) that achieves 84% accuracy at 38% of single-model cost, demonstrating that model routing dominates prompt engineering as a cost lever. We release QCV-Dataset (132 circuits, 5 modalities, 1,931 files) on Hugging Face Hub as an open evaluation infrastructure with structured metadata for discoverability, interoperability, and responsible AI documentation, and all evaluation code, cost logs, and verification scripts on GitHub for full reproducibility.

量子计算多模态模型评估成本优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。