通过频率选择解决量子编码中的梯度失效问题,提升训练稳定性与性能。
Mitigating Exponential Mixed Frequency Growth through Frequency Selection
- 引入频率选择机制,仅保留目标函数中的有效频率
- 二维任务中达到近优表现(中位R²≈0.95),高频率下仍稳定(中位R²≈0.85)
- 适用于真实数据集,突破传统密集编码的可扩展性瓶颈
角度编码已成为将经典数据嵌入量子模型的流行特征映射方式,能自然生成具有通用函数逼近能力的截断傅里叶级数。尽管表达能力强,实际训练仍面临严峻挑战。通过白盒目标函数的受控实验,我们发现即使满足所有既定参数充分条件,训练仍可能失败。基于Duffy和Jastrzebski的冗余-梯度框架,我们系统性地证明了非唯一频率主导梯度景观,并排斥目标频率——这一负担在单精度编码下随编码深度呈指数增长。小角度初始化可在一维场景缓解问题,但在高维场景失效;即使是减少每频率冗余的三元编码,也因唯一频率元组的组合爆炸而无法求解,无论初始化或优化器如何选择。为此,我们提出频率选择作为原则性解决方案,将模型频谱限制为仅包含目标函数中的频率。在二维目标上,该方法实现近优性能(中位R²≈0.95),而密集方法难以收敛;在高频量级下仍保持可处理性(中位R²≈0.85),而密集方法完全失效。真实数据集上的验证表明该方法可泛化至真实场景。
原文摘要 · Abstract (English)
Angle encoding has emerged as a popular feature map for embedding classical data into quantum models, naturally generating truncated Fourier series with universal function approximation capabilities. Despite this expressive capability, practical training faces significant challenges. Through controlled experiments with white-box target functions, we demonstrate that training failures can occur even when all established parameter sufficiency conditions are satisfied. Building on the redundancy-gradient framework of Duffy and Jastrzebski, we provide systematic experimental evidence that non-unique frequencies dominate the gradient landscape and crowd out target frequencies -- a burden that grows exponentially with encoding depth under unary encoding. Small-angle initialization mitigates this in one-dimensional settings but fails to scale to higher dimensions, where even ternary encoding -- which minimizes per-frequency redundancy -- faces intractable combinatorial growth of unique frequency tuples regardless of initialization or optimizer choice. We introduce frequency selection as a principled solution that restricts the model spectrum to only those frequencies present in the target function. For two-dimensional targets, frequency selection achieves near-optimal performance (median $R^2 \approx 0.95$) where dense approaches struggle, and remains tractable at high-frequency magnitudes where dense approaches fail entirely (median $R^2 \approx 0.85$). Validation on a real-world dataset confirms the approach transfers beyond synthetic settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。