用测试时增强提升表格转图像模型在分布外情况下的鲁棒性
Test-Time Augmentation for Tabular-to-Image Classifiers under Distribution Shifts
- 对六种表格转图像方法应用25种测试时增强策略
- 复合与光照类增强显著提升分布外性能,频率域变换则降低效果
- 适合关注表格数据视觉化模型泛化能力的研究者
将表格数据转换为视觉表示的表征方法已成为利用深度学习高性能的新范式。尽管具备优势,这些方法在分布偏移下的鲁棒性仍研究不足。测试时增强(TTA)是图像分类中提升模型泛化与鲁棒性的有效方法,通过聚合同一输入多视角变换后的预测结果实现。本文评估了六种表格转图像编码方法(TINTO、IGTD、DeepInsight、BIE、DistanceMatrix、Fotomics)在分布外(OOD)场景下使用25种TTA技术的表现。这些技术分为六类:几何、光照、结构、频域/编码、Mixup和复合。实验基于TableShift基准的两个数据集(HELOC和Voting),其包含分布内与分布外测试子集。结果表明,TTA能提升分布外性能,其中复合型与光照类策略在鲁棒性与方差间取得最佳平衡;而改变编码器特征到强度映射的频域变换则持续损害性能。研究揭示了TTA在提升表格数据图像表示分类器鲁棒性方面的潜力,尤其在分布偏移场景下。
原文摘要 · Abstract (English)
Tabular-to-image methods that convert tabular data into visual representations have emerged as a novel paradigm for leveraging the high performance of deep learning models. Despite their advantages, the robustness of these methods under distribution shifts remains under explored. Test-Time Augmentation (TTA) is an effective approach in image classification to improve model generalization and robustness, where predictions over multiple transformed views of each input are aggregated. This work evaluates the impact of TTA techniques on predictive performance under Out-Of-Distribution (OOD) for representations generated by tabular-to-image methods. Six tabular-to-image encoding methods were considered: TINTO, IGTD, DeepInsight, BIE, DistanceMatrix, Fotomics. Twenty-five TTA techniques were used, organized into six types: Geometric, Photometric, Structural, Frequency/Encoding, Mixup, and Composite. We employed two datasets from the TableShift benchmark (HELOC and Voting) that provide in-distribution and OOD test subsets designed to evaluate the effect of distribution shifts on tabular data. The results indicate that TTA improves OOD performance, with composite and photometric strategies providing the best trade-off between robustness and variance. In contrast, frequency-domain transformations that alter the encoder's feature-to-intensity mapping consistently degrade performance. These findings highlight TTA as a promising approach for improving the robustness and generalization of classifiers trained on image representations derived from tabular data, particularly under distribution shifts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。