用光子计算加速随机生成,让受限玻尔兹曼机更快更省电。
Photonic restricted Boltzmann machine for content generation tasks
- 光子架构替代电子计算,实现 $O(1)$ 复杂度的吉布斯采样
- 实验验证相变温度与理论值一致,生成图像和时序数据鲁棒性强
- 适合大规模生成任务,降低训练成本,推动光子生成AI发展
受限玻尔兹曼机(RBM)是一种基于伊辛模型的神经网络,擅长学习概率分布并随机生成新内容。然而,电子实现中吉布斯采样的高计算成本构成显著瓶颈。本文提出光子受限玻尔兹曼机(PRBM),利用光子计算加速吉布斯采样,实现高效内容生成。通过引入高效编码方法,PRBM避免了耗时的矩阵分解,将吉布斯采样的计算复杂度从 $O(N)$ 降至 $O(1)$。其非冯·诺依曼光子计算架构无需存储交互矩阵,在大规模RBM中具有显著优势。实验通过模拟二维伊辛模型验证光子加速采样,观测到的相变温度与理论预测高度一致。除物理启发任务外,PRBM在图像和时序序列生成与恢复中表现稳健,即使在噪声和畸变下仍具强鲁棒性。其可扩展性与低训练成本凸显其在光子生成人工智能中的巨大潜力。
原文摘要 · Abstract (English)
The restricted Boltzmann machine (RBM) is a neural network based on the Ising model, well known for its ability to learn probability distributions and stochastically generate new content. However, the high computational cost of Gibbs sampling in content generation tasks imposes significant bottlenecks on electronic implementations. Here, we propose a photonic restricted Boltzmann machine (PRBM) that leverages photonic computing to accelerate Gibbs sampling, enabling efficient content generation. By introducing an efficient encoding method, the PRBM eliminates the need for computationally intensive matrix decomposition and reduces the computational complexity of Gibbs sampling from $O(N)$ to $O(1)$. Moreover, its non-Von Neumann photonic computing architecture circumvents the memory storage of interaction matrices, providing substantial advantages for large-scale RBMs. We experimentally validate the photonic-accelerated Gibbs sampling by simulating a two-dimensional Ising model, where the observed phase transition temperature closely matches the theoretical predictions. Beyond physics-inspired tasks, the PRBM demonstrates robust capabilities in generating and restoring diverse content, including images and temporal sequences, even in the presence of noise and aberrations. The scalability and reduced training cost of the PRBM framework underscore its potential as a promising pathway for advancing photonic computing in generative artificial intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。