arXiv:2411.08164cs.LGcs.CV2024-11被引 1

提出通用特征提取器EAPCR,解决科学数据无显式关系模式的深度学习难题。

EAPCR: A Universal Feature Extractor for Scientific Data without Explicit Feature Relation Patterns

  • 设计EAPCR,无需依赖特征间显式关系即可提取科学数据特征
  • 在多类科学任务中表现优于传统方法,合成数据集上超越KAN/CNN/GCN/Transformer
  • 适合处理异构、无明确结构的科学数据,如医疗诊断与催化预测

传统方法(如决策树)在非图像类科学任务(如医学诊断、系统异常检测、无机催化效率预测)中表现优异,但多数深度学习技术难以匹敌。主要原因是这些任务涉及多源异构数据,特征间缺乏显式关系模式,不同于图像中的空间关系、文本中的序列依赖或图数据中的连接结构。本文提出EAPCR,一种专为无显式特征关系模式的数据设计的通用特征提取器。在多种科学任务中测试表明,EAPCR持续优于传统方法,并填补了深度学习在此类场景下的性能空白。为进一步验证其鲁棒性,我们构建了一个无显式特征关系模式的合成数据集。在该数据集上,KAN、CNN、GCN和Transformer均表现不佳,而EAPCR仍表现出色,证实其在无特征关系模式的科学任务中具有优越性能与强鲁棒性。

原文摘要 · Abstract (English)

Conventional methods, including Decision Tree (DT)-based methods, have been effective in scientific tasks, such as non-image medical diagnostics, system anomaly detection, and inorganic catalysis efficiency prediction. However, most deep-learning techniques have struggled to surpass or even match this level of success as traditional machine-learning methods. The primary reason is that these applications involve multi-source, heterogeneous data where features lack explicit relationships. This contrasts with image data, where pixels exhibit spatial relationships; textual data, where words have sequential dependencies; and graph data, where nodes are connected through established associations. The absence of explicit Feature Relation Patterns (FRPs) presents a significant challenge for deep learning techniques in scientific applications that are not image, text, and graph-based. In this paper, we introduce EAPCR, a universal feature extractor designed for data without explicit FRPs. Tested across various scientific tasks, EAPCR consistently outperforms traditional methods and bridges the gap where deep learning models fall short. To further demonstrate its robustness, we synthesize a dataset without explicit FRPs. While Kolmogorov-Arnold Network (KAN) and feature extractors like Convolutional Neural Networks (CNNs), Graph Convolutional Networks (GCNs), and Transformers struggle, EAPCR excels, demonstrating its robustness and superior performance in scientific tasks without FRPs.

特征提取科学计算深度学习通用模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。