arXiv:2411.11162cs.LGcs.AI2024-11

RPN 2 统一 CNN、RNN、GNN 与 Transformer,通过显式建模数据依赖性提升性能。

RPN 2: On Interdependence Function Learning Towards Unifying and Advancing CNN, RNN, GNN, and Transformer

  • 引入依赖函数显式建模数据间关联,突破传统独立性假设限制。
  • 在复杂数据上显著提升学习性能,统一多种主流神经网络架构。
  • 为设计超越现有模型的新架构提供理论基础,适合架构研究者参考。

本文基于先前的修正多项式网络(RPN)工作,提出新版本 RPN 2。原始 RPN 假设输入数据独立,包括批次内样本及实例内属性间均独立,但此假设在语言、图像、时序和图等复杂依赖数据任务中常不成立,忽略依赖性会导致性能严重下降。为此,RPN 2 引入数据与结构依赖函数,在模型架构中显式建模数据依赖性。该改进不仅显著提升学习性能,还大幅拓展其统一能力,使其可涵盖卷积神经网络(CNN)、循环神经网络(RNN)、图神经网络(GNN)和 Transformer 等主流骨干模型。分析表明,这些模型的核心差异主要源于对依赖函数的不同定义方式。该统一表示也为设计超越现有骨干模型的创新架构提供了新可能。

原文摘要 · Abstract (English)

This paper builds upon our previous work on the Reconciled Polynomial Network (RPN). The original RPN model was designed under the assumption of input data independence, presuming the independence among both individual instances within data batches and attributes in each data instance. However, this assumption often proves invalid for function learning tasks involving complex, interdependent data such as language, images, time series, and graphs. Ignoring such data interdependence may inevitably lead to significant performance degradation. To overcome these limitations, we introduce the new Reconciled Polynomial Network (version 2), namely RPN 2, in this paper. By incorporating data and structural interdependence functions, RPN 2 explicitly models data interdependence via new component functions in its architecture. This enhancement not only significantly improves RPN 2's learning performance but also substantially expands its unifying potential, enabling it to encompass a broader range of contemporary dominant backbone models within its canonical representation. These backbones include, but are not limited to, convolutional neural networks (CNNs), recurrent neural networks (RNNs), graph neural networks (GNNs), and Transformers. Our analysis reveals that the fundamental distinctions among these backbone models primarily stem from their diverse approaches to defining the interdependence functions. Furthermore, this unified representation opens up new opportunities for designing innovative architectures with the potential to surpass the performance of these dominant backbones.

神经网络统一框架依赖建模深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。