arXiv:2501.03540cs.LGcs.AI2025-01被引 21

系统梳理表格数据表示学习的前沿方法与未来方向。

Deep Learning within Tabular Data: Foundations, Challenges, Advances and Future Directions

  • 从数据、模型、目标三方面构建完整技术框架
  • 涵盖127篇2020年后顶会顶刊论文,覆盖数据增强与Transformer应用
  • 适合关注表格数据建模、自监督学习的研究者

表格数据在众多实际应用中仍是最普遍的数据类型,但其不规则模式、异构特征分布及复杂列间依赖关系给有效表示学习带来独特挑战。本文综述了表格数据表示学习的最新技术,围绕训练数据、神经架构和学习目标三个基础设计要素展开。不同于以往仅关注架构或学习策略的综述,本文采用整体视角,强调表示学习方法在多样化下游任务中的普适性与鲁棒性。我们分析了近期在数据增强与生成、面向表格数据的专用神经网络架构,以及提升表示质量的创新学习目标方面的进展。此外,还重点讨论了自监督学习的兴起以及基于Transformer的预训练模型在表格数据中的适配应用。本综述基于严格的纳入标准,系统检索了2020年以来发表于顶级会议与期刊的127篇论文。通过详细分析与对比,识别出新兴趋势、关键空白点,并提出未来研究的有前景方向,旨在指导更通用、高效的表格数据表示学习方法的发展。

原文摘要 · Abstract (English)

Tabular data remains one of the most prevalent data types across a wide range of real-world applications, yet effective representation learning for this domain poses unique challenges due to its irregular patterns, heterogeneous feature distributions, and complex inter-column dependencies. This survey provides a comprehensive review of state-of-the-art techniques in tabular data representation learning, structured around three foundational design elements: training data, neural architectures, and learning objectives. Unlike prior surveys that focus primarily on either architecture design or learning strategies, we adopt a holistic perspective that emphasizes the universality and robustness of representation learning methods across diverse downstream tasks. We examine recent advances in data augmentation and generation, specialized neural network architectures tailored to tabular data, and innovative learning objectives that enhance representation quality. Additionally, we highlight the growing influence of self-supervised learning and the adaptation of transformer-based foundation models for tabular data. Our review is based on a systematic literature search using rigorous inclusion criteria, encompassing 127 papers published since 2020 in top-tier conferences and journals. Through detailed analysis and comparison, we identify emerging trends, critical gaps, and promising directions for future research, aiming to guide the development of more generalizable and effective tabular data representation methods.

表格数据表示学习自监督Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。