arXiv:2603.14898quant-phcs.ET2026-03

用光量子硬件生成随机信号,提升小模型压缩效果。

Photonic Quantum-Enhanced Knowledge Distillation

  • 用可编程光电路生成约束信号,指导学生模型训练
  • 在多个数据集上实现高压缩率下接近教师模型性能
  • 适合关注量子增强学习与模型压缩的研究者

光量子处理器天然产生结构化随机测量结果,可作为机器学习训练中的硬件级随机源。本文提出光量子增强知识蒸馏(PQKD),一种混合量子光子-经典框架:可编程光电路生成紧凑的条件信号,指导参数高效的的学生网络从高容量教师网络中学习。PQKD将全可训练卷积核替换为字典卷积:每层仅学习少量共享空间基滤波器,样本依赖的通道混合权重则由有限采样光特征经固定线性变换得出。训练交替进行标准梯度优化与采样鲁棒的无梯度光参数更新,避免对光硬件求导。在MNIST、Fashion-MNIST和CIFAR-10上,PQKD实现了可控的压缩-精度权衡,在极端卷积压缩下仍保持接近教师性能;性能随有限采样呈预期下降,符合光子噪声标度规律;指数移动平均特征平滑有效抑制高频噪声波动,扩展了中等采样预算下的实用操作范围。

原文摘要 · Abstract (English)

Photonic quantum processors naturally produce intrinsically stochastic measurement outcomes, offering a hardware-native source of structured randomness that can be exploited during machine-learning training. Here we introduce Photonic Quantum-Enhanced Knowledge Distillation (PQKD), a hybrid quantum photonic--classical framework in which a programmable photonic circuit generates a compact conditioning signal that constrains and guides a parameter-efficient student network during distillation from a high-capacity teacher. PQKD replaces fully trainable convolutional kernels with dictionary convolutions: each layer learns only a small set of shared spatial basis filters, while sample-dependent channel-mixing weights are derived from shot-limited photonic features and mapped through a fixed linear transform. Training alternates between standard gradient-based optimisation of the student and sampling-robust, gradient-free updates of photonic parameters, avoiding differentiation through photonic hardware. Across MNIST, Fashion-MNIST and CIFAR-10, PQKD traces a controllable compression--accuracy frontier, remaining close to teacher performance on simpler benchmarks under aggressive convolutional compression. Performance degrades predictably with finite sampling, consistent with shot-noise scaling, and exponential moving-average feature smoothing suppresses high-frequency shot-noise fluctuations, extending the practical operating regime at moderate shot budgets.

量子机器学习知识蒸馏光子计算模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。