arXiv:2409.07310cs.LGcs.NE2024-09

用数论方程编码神经网络参数,提升模型可解释性与鲁棒性。

Optimizing Neural Network Performance and Interpretability with Diophantine Equation Encoding

  • 将网络参数转化为丢番图方程的整数解,约束训练过程。
  • 在图像分类与自然语言任务中提升准确率与收敛速度。
  • 适合关注模型可解释性与对抗防御的研究者。

本文探索将丢番图方程融入神经网络架构,以提升模型的可解释性、稳定性与效率。通过将神经网络参数编码与解码为丢番图方程的整数解,提出一种新方法,增强深度学习模型的精度与鲁棒性。该方法引入自定义损失函数,在训练中施加丢番图约束,实现更优泛化性能、更小误差边界,并增强对对抗攻击的抵御能力。实验在图像分类与自然语言处理任务中验证了该方法的有效性,观察到准确率提升、收敛加速及鲁棒性增强。本研究为数学理论与机器学习的融合提供了新视角,助力构建更具可解释性与高效性的模型。

原文摘要 · Abstract (English)

This paper explores the integration of Diophantine equations into neural network (NN) architectures to improve model interpretability, stability, and efficiency. By encoding and decoding neural network parameters as integer solutions to Diophantine equations, we introduce a novel approach that enhances both the precision and robustness of deep learning models. Our method integrates a custom loss function that enforces Diophantine constraints during training, leading to better generalization, reduced error bounds, and enhanced resilience against adversarial attacks. We demonstrate the efficacy of this approach through several tasks, including image classification and natural language processing, where improvements in accuracy, convergence, and robustness are observed. This study offers a new perspective on combining mathematical theory and machine learning to create more interpretable and efficient models.

可解释性神经网络丢番图方程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。