arXiv:2409.12990q-bio.NCcs.AI2024-09

用脑启发的双曲几何提升神经网络性能

Brain-Inspired AI with Hyperbolic Geometry

  • 以大脑层级结构为灵感,用双曲几何建模神经网络
  • 在自然语言处理等任务中参数更少、泛化更好
  • 适合追求高效高精度模型的研究者参考

人工神经网络(ANNs)受人类大脑架构与功能启发,已彻底改变人工智能领域。本文从大脑潜在几何结构出发,提出在神经网络与机器学习中引入双曲几何将显著提升准确性、优化特征空间表示,并增强模型效率。研究指出,大脑的无标度分层组织与双曲几何高度契合,而双曲神经网络在自然语言处理、计算机视觉和复杂网络分析等任务中,相比欧氏模型表现更优,所需参数更少,泛化能力更强。尽管目前应用仍处初期,但双曲几何作为脑启发的几何表征,有望推动机器学习模型的进一步发展。

原文摘要 · Abstract (English)

Artificial neural networks (ANNs) were inspired by the architecture and functions of the human brain and have revolutionised the field of artificial intelligence (AI). Inspired by studies on the latent geometry of the brain, in this perspective paper we posit that an increase in the research and application of hyperbolic geometry in ANNs and machine learning will lead to increased accuracy, improved feature space representations and more efficient models across a range of tasks. We examine the structure and functions of the human brain, emphasising the correspondence between its scale-free hierarchical organization and hyperbolic geometry, and reflecting on the central role hyperbolic geometry plays in facilitating human intelligence. Empirical evidence indicates that hyperbolic neural networks outperform Euclidean models for tasks including natural language processing, computer vision and complex network analysis, requiring fewer parameters and exhibiting better generalisation. Despite its nascent adoption, hyperbolic geometry holds promise for improving machine learning models through brain-inspired geometric representations.

脑启发双曲几何神经网络表征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。