arXiv:2411.06020cs.LG2024-11被引 2

通过并行路径处理长列数据,提升模型效率与性能。

Parallel Multi-path Feed Forward Neural Networks (PMFFNN) for Long Columnar Datasets: A Novel Approach to Complexity Reduction

  • 将输入列分组并行处理,聚焦特征子集
  • 在多个基准数据集上优于传统FFNN与1D CNN
  • 适合高维长列数据的高效建模

传统前馈神经网络(FFNN)和一维卷积神经网络(1D CNN)在处理包含大量特征的长列数据时面临挑战,主要源于数据量大及特征间关系弱。传统训练中,大规模数据常导致模型无法充分利用输入信息,影响学习效果。为此,本文提出并行多路径前馈神经网络(PMFFNN),通过多条并行路径分别处理输入数据的不同列子集,使每条路径专注特定特征范围,提升特征多样性利用效率。该架构一方面通过任务分配有效应对长列数据,另一方面通过缩小每路径特征范围降低模型复杂度,实现更快训练速度与更高资源效率。实验表明,PMFFNN在多个基准数据集上显著优于传统模型,为大规模列式数据提供了优化解决方案。

原文摘要 · Abstract (English)

Traditional Feed-Forward Neural Networks (FFNN) and one-dimensional Convolutional Neural Networks (1D CNN) often encounter difficulties when dealing with long, columnar datasets that contain numerous features. The challenge arises from two primary factors: the large volume of data and the potential absence of meaningful relationships between features. In conventional training, large datasets can overwhelm the model, causing significant portions of the input to remain underutilized. As a result, the model may fail to capture the critical information necessary for effective learning, which leads to diminished performance. To overcome these limitations, we introduce a novel architecture called Parallel Multi-path Feed Forward Neural Networks (PMFFNN). Our approach leverages multiple parallel pathways to process distinct subsets of columns from the input dataset. By doing so, the architecture ensures that each subset of features receives focused attention, which is often neglected in traditional models. This approach maximizes the utilization of feature diversity, ensuring that no critical data sections are overlooked during training. Our architecture offers two key advantages. First, it allows for more effective handling of long, columnar data by distributing the learning task across parallel paths. Second, it reduces the complexity of the model by narrowing the feature scope in each path, which leads to faster training times and improved resource efficiency. The empirical results indicate that PMFFNN outperforms traditional FFNNs and 1D CNNs, providing an optimized solution for managing large-scale data.

神经网络数据处理模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。