arXiv:2510.17867cs.NEcs.AI2025-10综述

系统梳理递归与循环神经网络的分类与演进,揭示其在序列处理中的核心作用。

A Survey of Recursive and Recurrent Neural Networks

  • 按结构与学习机制将模型分为三类:通用型、结构化、其他类型
  • 涵盖从LSTM到图网络等数十种变体,形成复杂关联体系
  • 适合深度学习研究者快速掌握递归网络发展脉络

本文依据网络结构、训练目标函数及学习算法实现,对递归与循环神经网络进行详细分类。大致分为三类:第一类为通用递归与循环神经网络,包括基础型、长短期记忆型、卷积型、微分型、单层型、高阶型、高速公路网络、多维型、双向型;第二类为结构化递归与循环神经网络,包括网格型、图型、时序型、格点型、层次型、树型;第三类为其他类型,包括数组型长短期记忆、嵌套与堆叠型、记忆型网络。各类模型相互交叉甚至依赖,形成复杂关系网。在各类网络融合发展背景下,诸多复杂序列、语音与图像问题得以解决。本文详述各模型原理与结构,总结其研究进展与应用,并对未来发展方向进行展望与归纳。

原文摘要 · Abstract (English)

In this paper, the branches of recursive and recurrent neural networks are classified in detail according to the network structure, training objective function and learning algorithm implementation. They are roughly divided into three categories: The first category is General Recursive and Recurrent Neural Networks, including Basic Recursive and Recurrent Neural Networks, Long Short Term Memory Recursive and Recurrent Neural Networks, Convolutional Recursive and Recurrent Neural Networks, Differential Recursive and Recurrent Neural Networks, One-Layer Recursive and Recurrent Neural Networks, High-Order Recursive and Recurrent Neural Networks, Highway Networks, Multidimensional Recursive and Recurrent Neural Networks, Bidirectional Recursive and Recurrent Neural Networks; the second category is Structured Recursive and Recurrent Neural Networks, including Grid Recursive and Recurrent Neural Networks, Graph Recursive and Recurrent Neural Networks, Temporal Recursive and Recurrent Neural Networks, Lattice Recursive and Recurrent Neural Networks, Hierarchical Recursive and Recurrent Neural Networks, Tree Recursive and Recurrent Neural Networks; the third category is Other Recursive and Recurrent Neural Networks, including Array Long Short Term Memory, Nested and Stacked Recursive and Recurrent Neural Networks, Memory Recursive and Recurrent Neural Networks. Various networks cross each other and even rely on each other to form a complex network of relationships. In the context of the development and convergence of various networks, many complex sequence, speech and image problems are solved. After a detailed description of the principle and structure of the above model and model deformation, the research progress and application of each model are described, and finally the recursive and recurrent neural network models are prospected and summarized.

神经网络递归网络综述序列建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。