arXiv:2601.01441physics.app-phcs.CV2026-01

用自旋电子学硬件实现低功耗图像生成,性能接近传统模型。

Image Synthesis Using Spintronic Deep Convolutional Generative Adversarial Network

  • 将生成对抗网络的卷积与反卷积层改造为适合自旋电子器件的结构。
  • 在时尚和动漫人脸数据集上分别达到FID 27.5和45.4,测试能耗仅几纳焦。
  • 创新使用磁畴壁位置编码实现可调漏失线性单元,能效达0.192皮焦。

生成对抗网络(GAN)的计算需求已超出传统冯·诺依曼架构的极限,亟需能效更高的替代方案,如类脑自旋电子技术。本文提出一种混合CMOS-自旋电子深度卷积生成对抗网络(DCGAN)架构,用于合成图像生成。该模型沿用标准框架,通过生成器与判别器的对抗训练,并利用自旋电子硬件实现DCGAN中的卷积、反卷积及激活层。为适配硬件,生成器的反卷积层重构为零填充卷积,可无缝集成基于6位自旋子的交叉阵列,且不损失训练性能。非线性激活函数采用混合CMOS磁畴壁结构的修正线性单元(ReLU)与漏失线性单元(Leaky ReLU)。所提可调漏失线性单元通过磁畴壁位置编码实现连续电阻态,结合平行磁隧道结读出,具有片上可调的双抛物各向异性剖面,功耗仅为0.192皮焦。该自旋电子DCGAN模型在灰度与彩色数据集上均表现良好,对Fashion MNIST数据集的弗雷歇起始距离(FID)为27.5,对Anime Face数据集为45.4;测试能耗分别为4.9纳焦(训练能耗14.97~24.72纳焦/图像),在24.72纳焦(训练能耗74.7纳焦/图像)。

原文摘要 · Abstract (English)

The computational requirements of generative adversarial networks (GANs) exceed the limit of conventional Von Neumann architectures, necessitating energy efficient alternatives such as neuromorphic spintronics. This work presents a hybrid CMOS-spintronic deep convolutional generative adversarial network (DCGAN) architecture for synthetic image generation. The proposed generative vision model approach follows the standard framework, leveraging generator and discriminators adversarial training with our designed spintronics hardware for deconvolution, convolution, and activation layers of the DCGAN architecture. To enable hardware aware spintronic implementation, the generator's deconvolution layers are restructured as zero padded convolution, allowing seamless integration with a 6-bit skyrmion based synapse in a crossbar, without compromising training performance. Nonlinear activation functions are implemented using a hybrid CMOS domain wall based Rectified linear unit (ReLU) and Leaky ReLU units. Our proposed tunable Leaky ReLU employs domain wall position coded, continuous resistance states and a piecewise uniaxial parabolic anisotropy profile with a parallel MTJ readout, exhibiting energy consumption of 0.192 pJ. Our spintronic DCGAN model demonstrates adaptability across both grayscale and colored datasets, achieving Fr'echet Inception Distances (FID) of 27.5 for the Fashion MNIST and 45.4 for Anime Face datasets, with testing energy (training energy) of 4.9 nJ (14.97~nJ/image) and 24.72 nJ (74.7 nJ/image).

自旋电子图像生成低功耗神经形态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。