用模拟硬件生成图像,能效比数字模型高100倍。
Generative Models on Analog Hardware with Dynamics

- 设计可适配硬件的动态系统框架,支持低功耗生成建模。
- 4位稀疏架构下生成图像能耗仅23微焦,能效提升百倍。
- 在手写数字和服装图像生成上表现超越以往硬件模型3-4倍。
类比硬件平台如耦合振荡器和模拟伊辛机以极低能耗自然求解微分方程,适合低功耗生成建模,但存在根本矛盾:现代生成模型依赖灵活的软件动态,而模拟硬件受限于固定的物理微分方程,逼近能力有限。本文提出模拟交互系统(AIS)统一框架,并实证刻画其表达能力与神经网络基线的差距。提出两种硬件兼容机制——时变分段参数与隐藏物理状态,并开发基于Wasserstein GAN的训练方法,无需指定特定轨迹即可训练。分析面积与功耗随连接密度和精度的扩展规律,表明稀疏连接与低比特量化参数对实际部署至关重要。所选架构每生成一张图像能耗为23微焦,相较数字基线降低两个数量级。在MNIST和Fashion-MNIST数据集上,基于振荡器的AIS分别取得FID 27.6和80.8,优于此前最优硬件实现3-4倍,且采用4位稀疏结构。
原文摘要 · Abstract (English)
Analog hardware platforms such as coupled oscillators and Analog Ising Machines naturally solve differential equations at a fraction of the energy cost of digital computation, making them attractive for low-power generative modeling, yet a fundamental mismatch exists: modern generative models assume flexible, software-defined dynamics, whereas analog hardware imposes fixed, physics-determined differential equations with limited approximation capacity. This paper introduces Analog Interaction Systems (AIS), a unified framework for hardware-implementable dynamical systems, and empirically characterizes their expressivity gap relative to neural network baselines. Two hardware-compatible mechanisms are proposed to narrow this gap - time-varying piecewise parameters and hidden physical states - and a Wasserstein GAN training procedure is developed to enable training of these models without requiring them to follow a specific trajectory. We characterize how area and power scale with connection density and precision, showing that sparse connectivity and low-bit-width quantized parameters are necessary for practical implementation, and estimate an energy cost of 23uJ per generated image for the chosen architecture, representing a 2-orders-of-magnitude improvement over digital baselines. On MNIST and Fashion-MNIST, our oscillator-based AIS achieves FID scores of 27.6 and 80.8, outperforming the best prior hardware-implementable analog generative models by 3-4x with a 4-bit sparse architecture.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。