arXiv:2601.15340cond-mat.dis-nncond-mat.mes-hall2026-01被引 4

让物理器件的非线性可学习,显著提升能效与性能。

Learning Nonlinear Heterogeneity in Physical Kolmogorov-Arnold Networks

  • 通过训练器件本身的非线性,而非仅调权重
  • 实测在微安级电流下每操作仅耗750飞焦,性能超传统网络
  • 适合低功耗、高效率的硬件神经网络应用

传统物理神经网络通常只训练线性突触权重,将器件非线性视为固定。本文反其道而行之,采用柯尔莫戈罗夫-阿诺德网络(KAN)架构,直接训练突触非线性,在硅绝缘体器件上实现物理KAN,命名为‘突触非线性元件’(SYNE)。实验在室温下运行,电流为微安级,速度达2 MHz,每次非线性操作耗能约750 fJ,历经10^13次测量和数月未见退化。成功完成非线性函数拟合、分类及锂离子电池动态预测,任务表现优于同等参数的软件多层感知机,参数量少两个数量级,器件数也减少两个数量级。结果证明,可学习的物理非线性是紧凑高效学习系统的原生计算范式,SYNE是异构非线性计算的有效载体。

原文摘要 · Abstract (English)

Physical neural networks typically train linear synaptic weights while treating device nonlinearities as fixed. We show the opposite - by training the synaptic nonlinearity itself, as in Kolmogorov-Arnold Network (KAN) architectures, we yield markedly higher task performance per physical resource and improved performance-parameter scaling than conventional linear weight-based networks, demonstrating ability of KAN topologies to exploit reconfigurable nonlinear physical dynamics. We experimentally realise physical KANs in silicon-on-insulator devices we term 'Synaptic Nonlinear Elements' (SYNEs), operating at room temperature, microampere currents, 2 MHz speeds and ~750 fJ per nonlinear operation, with no observed degradation over 10^13 measurements and months-long timescales. We demonstrate nonlinear function regression, classification, and prediction of Li-Ion battery dynamics from noisy real-world multi-sensor data. Physical KANs outperform equivalently-parameterised software multilayer perceptron networks across all tasks, with up to two orders of magnitude fewer parameters, and two orders of magnitude fewer devices than linear weight based physical networks. These results establish learned physical nonlinearity as a hardware-native computational primitive for compact and efficient learning systems, and SYNE devices as effective substrates for heterogenous nonlinear computing.

物理神经网络非线性器件低功耗计算KAN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。