对比七种神经算子对霍奇金-赫胥黎模型的平移不变性表现。
Translation Invariance of Neural Operators for the FitzHugh-Nagumo Model
- 设计新训练策略,测试模型在时空平移下的泛化能力。
- CNO性能稳定但训练成本高,FNO精度高但推理慢。
- 适合研究神经算子在生物电模型中泛化能力的学者。
神经算子(NOs)是一种强大的深度学习框架,用于学习偏微分方程所导出的解算子。本文研究了神经算子对描述兴奋性细胞的菲茨休-纳古莫模型的刚性时空动态的捕捉能力。关键贡献在于提出一种新型训练策略,评估其平移不变性:在固定时间下,使用不同空间位置和强度的外加电流进行训练;测试集则引入更具挑战性的分布外场景,即外加电流在时间和空间上均发生平移。该方法显著降低了数据集生成的计算成本。同时,我们基准测试了七种神经算子架构:卷积神经算子(CNOs)、深度算子网络(DONs)、带CNN编码器的DONs(DONs-CNN)、本征正交分解的DONs(POD-DONs)、傅里叶神经算子(FNOs)、张量分解型FNO(TFNOs)、局部神经算子(LocalNOs)。基于训练与测试准确率、效率及推理速度进行评估。结果表明,CNO在平移测试动态中表现良好,但训练成本较高,其训练集性能与其他架构相当。相反,FNO具有最低训练误差,但推理时间最长。对于平移动态,FNO及其变体预测准确性较低。而DON及其变体在训练与推理中均表现出高效率,但在测试集上泛化能力较差。这些发现揭示了当前神经算子在捕捉复杂离子模型动态方面的优劣,并提供了包含平移动态应用的综合性基准。
原文摘要 · Abstract (English)
Neural Operators (NOs) are a powerful deep learning framework designed to learn the solution operator that arise from partial differential equations. This study investigates NOs ability to capture the stiff spatio-temporal dynamics of the FitzHugh-Nagumo model, which describes excitable cells. A key contribution of this work is evaluating the translation invariance using a novel training strategy. NOs are trained using an applied current with varying spatial locations and intensities at a fixed time, and the test set introduces a more challenging out-of-distribution scenario in which the applied current is translated in both time and space. This approach significantly reduces the computational cost of dataset generation. Moreover we benchmark seven NOs architectures: Convolutional Neural Operators (CNOs), Deep Operator Networks (DONs), DONs with CNN encoder (DONs-CNN), Proper Orthogonal Decomposition DONs (POD-DONs), Fourier Neural Operators (FNOs), Tucker Tensorized FNOs (TFNOs), Localized Neural Operators (LocalNOs). We evaluated these models based on training and test accuracy, efficiency, and inference speed. Our results reveal that CNOs performs well on translated test dynamics. However, they require higher training costs, though their performance on the training set is similar to that of the other considered architectures. In contrast, FNOs achieve the lowest training error, but have the highest inference time. Regarding the translated dynamics, FNOs and their variants provide less accurate predictions. Finally, DONs and their variants demonstrate high efficiency in both training and inference, however they do not generalize well to the test set. These findings highlight the current capabilities and limitations of NOs in capturing complex ionic model dynamics and provide a comprehensive benchmark including their application to scenarios involving translated dynamics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。