arXiv:2603.16569cs.LG2026-03TPAMI被引 2

不修改模型参数,用新方法提升表格数据的表示质量。

Deep Tabular Representation Corrector

  • 提出两个任务:修正表示偏移、映射到轻量嵌入空间。
  • 在多个基准上提升模型性能,且无需重新训练原模型。
  • 适合已训练好的表格模型优化,高效易用。

表格数据在医疗、工程、金融等多个现实领域中起着核心作用。深度学习的成功推动了基于Transformer、ResNet等网络的表格学习方法发展。现有方法主要分为两类:在学习(in-learning)需从头训练或施加约束,多任务同时学习导致难度增加;预学习(pre-learning)需设计预训练任务并进行微调,耗时且依赖先验知识。本文提出一种新型深度表格表示修正器TRC,以模型无关方式增强已训练深表模型的表示能力,不修改原模型参数。针对表示偏移和冗余问题,提出两项任务:(i) 表格表示重估,通过训练偏移估计器识别并缓解表示偏移,从而重估表示;(ii) 表格空间映射,利用坐标估计器将重估后的表示映射至轻量嵌入空间,保留关键预测信息并减少冗余。两项任务协同提升表示质量,且无需改动原模型,效率高。在多个主流表格基准上,与多种先进深表模型结合使用均取得一致优势。

原文摘要 · Abstract (English)

Tabular data have been playing a mostly important role in diverse real-world fields, such as healthcare, engineering, finance, etc. The recent success of deep learning has fostered many deep networks (e.g., Transformer, ResNet) based tabular learning methods. Generally, existing deep tabular machine learning methods are along with the two paradigms, i.e., in-learning and pre-learning. In-learning methods need to train networks from scratch or impose extra constraints to regulate the representations which nonetheless train multiple tasks simultaneously and make learning more difficult, while pre-learning methods design several pretext tasks for pre-training and then conduct task-specific fine-tuning, which however need much extra training effort with prior knowledge. In this paper, we introduce a novel deep Tabular Representation Corrector, TRC, to enhance any trained deep tabular model's representations without altering its parameters in a model-agnostic manner. Specifically, targeting the representation shift and representation redundancy that hinder prediction, we propose two tasks, i.e., (i) Tabular Representation Re-estimation, that involves training a shift estimator to calculate the inherent shift of tabular representations to subsequently mitigate it, thereby re-estimating the representations and (ii) Tabular Space Mapping, that transforms the above re-estimated representations into a light-embedding vector space via a coordinate estimator while preserves crucial predictive information to minimize redundancy. The two tasks jointly enhance the representations of deep tabular models without touching on the original models thus enjoying high efficiency. Finally, we conduct extensive experiments on state-of-the-art deep tabular machine learning models coupled with TRC on various tabular benchmarks which have shown consistent superiority.

表格学习表示修正模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。