零样本生成表格数据嵌入,无需训练即可聚类。
ZEUS: Zero-shot Embeddings for Unsupervised Separation of Tabular Data
- 基于预训练的隐变量生成合成数据,实现零样本泛化。
- 在多个数据集上性能媲美或超越传统与深度聚类方法。
- 免调参、速度快,适合快速分析新表格数据。
表格数据聚类仍是数据分析与机器学习中的重大挑战。与图像数据不同,表格记录间的相似性常因数据集而异,导致聚类定义高度依赖具体数据。此外,缺乏监督信号使深度学习聚类方法的超参数调优复杂,常导致性能不稳定。为解决这些问题并减少对每数据集调参的需求,我们采用深度学习中新兴的零样本学习范式。提出 ZEUS,一种无需额外训练或微调即可聚类新数据集的自包含模型。它通过将复杂数据分解为可有效聚类的有意义组件实现目标。得益于在从隐变量先验生成的合成数据上进行预训练,该模型可跨多种数据集泛化,且无需用户干预。据我们所知,ZEUS 是首个能在完全无监督条件下生成表格数据嵌入的零样本方法。实验表明,其性能与或优于传统聚类算法及近期深度学习方法,同时显著更快、更易用。
原文摘要 · Abstract (English)
Clustering tabular data remains a significant open challenge in data analysis and machine learning. Unlike for image data, similarity between tabular records often varies across datasets, making the definition of clusters highly dataset-dependent. Furthermore, the absence of supervised signals complicates hyperparameter tuning in deep learning clustering methods, frequently resulting in unstable performance. To address these issues and reduce the need for per-dataset tuning, we adopt an emerging approach in deep learning: zero-shot learning. We propose ZEUS, a self-contained model capable of clustering new datasets without any additional training or fine-tuning. It operates by decomposing complex datasets into meaningful components that can then be clustered effectively. Thanks to pre-training on synthetic datasets generated from a latent-variable prior, it generalizes across various datasets without requiring user intervention. To the best of our knowledge, ZEUS is the first zero-shot method capable of generating embeddings for tabular data in a fully unsupervised manner. Experimental results demonstrate that it performs on par with or better than traditional clustering algorithms and recent deep learning-based methods, while being significantly faster and more user-friendly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。