arXiv:2412.00238cs.CVcs.AI2024-12被引 5

TCN通过乘积交互增强特征表示,提升非空间数据分类性能。

Twisted Convolutional Networks (TCNs): Enhancing Feature Interactions for Non-Spatial Data Classification

  • 用多项式展开实现特征的成对乘积交互,捕捉高阶关联。
  • 在5个领域数据集上超越CNN、ResNet等主流模型,显著提升准确率。
  • 适合无固定顺序的1维数据,如医疗、化学等复杂特征场景。

提出一种新型深度学习架构Twisted Convolutional Networks(TCNs),用于分类一维任意特征顺序且空间关系弱的数据。与依赖结构化特征序列的传统卷积神经网络不同,TCNs通过理论支持的乘积与成对交互机制显式组合输入特征子集,生成更丰富的表示。该策略通过多项式特征扩展形式化,捕捉传统卷积方法遗漏的高阶特征交互。本文提供完整的数学框架,证明扭曲卷积操作在保持计算可处理性的同时推广了标准卷积。在医学诊断、政治科学、合成数据、化学计量学和医疗健康等五个不同领域的基准数据集上进行广泛实验,结果表明TCNs在统计上显著优于CNN、ResNet、图神经网络(GNN)、DeepSets及支持向量机(SVM)。性能提升经统计检验验证,且表现出更优的训练稳定性和泛化能力,凸显其在非空间数据分类任务中的鲁棒性。

原文摘要 · Abstract (English)

Twisted Convolutional Networks (TCNs) are proposed as a novel deep learning architecture for classifying one-dimensional data with arbitrary feature order and minimal spatial relationships. Unlike conventional Convolutional Neural Networks (CNNs) that rely on structured feature sequences, TCNs explicitly combine subsets of input features through theoretically grounded multiplicative and pairwise interaction mechanisms to create enriched representations. This feature combination strategy, formalized through polynomial feature expansions, captures high-order feature interactions that traditional convolutional approaches miss. We provide a comprehensive mathematical framework for TCNs, demonstrating how the twisted convolution operation generalizes standard convolutions while maintaining computational tractability. Through extensive experiments on five benchmark datasets from diverse domains (medical diagnostics, political science, synthetic data, chemometrics, and healthcare), we show that TCNs achieve statistically significant improvements over CNNs, Residual Networks (ResNet), Graph Neural Networks (GNNs), DeepSets, and Support Vector Machine (SVM). The performance gains are validated through statistical testing. TCNs also exhibit superior training stability and generalization capabilities, highlighting their robustness for non-spatial data classification tasks.

特征交互非空间数据深度学习分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。