针对高维小样本表格数据,提升关联规则挖掘效率与质量。
Discovering Association Rules in High-Dimensional Small Tabular Data
- 改进Aerial+模型,用表格式基础模型微调增强规则发现能力。
- 在5个真实数据集上,规则质量显著提升,尤其在低样本场景下。
- 解决高维小样本数据中规则爆炸难题,适合生物医学等低数据领域。
关联规则挖掘(ARM)旨在从数据中发现特征间的命题规则,支持高风险决策中的知识发现与可解释机器学习。然而,在高维场景下,规则爆炸和计算开销使主流算法难以应用,这一挑战延伸至下游任务。近期提出的神经符号方法如Aerial+虽缓解了高维问题,但继承了神经网络在低数据下的性能瓶颈。本文在高维小样本表格数据的关联规则发现方面做出三项贡献:首先,实证表明Aerial+在五个真实数据集上相比先进算法与神经符号基线,性能提升一到两个数量级;其次,提出高维低数据场景下的新问题,例如生物医学领域基因表达数据(约18,000特征、50样本);第三,提出两种基于表格式基础模型的Aerial+微调方法,显著提升五大数据集上的规则质量,验证其在低数据、高维场景下的有效性。
原文摘要 · Abstract (English)
Association Rule Mining (ARM) aims to discover patterns between features in datasets in the form of propositional rules, supporting both knowledge discovery and interpretable machine learning in high-stakes decision-making. However, in high-dimensional settings, rule explosion and computational overhead render popular algorithmic approaches impractical without effective search space reduction, challenges that propagate to downstream tasks. Neurosymbolic methods, such as Aerial+, have recently been proposed to address the rule explosion in ARM. While they tackle the high dimensionality of the data, they also inherit limitations of neural networks, particularly reduced performance in low-data regimes. This paper makes three key contributions to association rule discovery in high-dimensional tabular data. First, we empirically show that Aerial+ scales one to two orders of magnitude better than state-of-the-art algorithmic and neurosymbolic baselines across five real-world datasets. Second, we introduce the novel problem of ARM in high-dimensional, low-data settings, such as gene expression data from the biomedicine domain with around 18k features and 50 samples. Third, we propose two fine-tuning approaches to Aerial+ using tabular foundation models. Our proposed approaches are shown to significantly improve rule quality on five real-world datasets, demonstrating their effectiveness in low-data, high-dimensional scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。