arXiv:2503.18048cs.LGstat.ML2025-03

用可解释的多项式模型捕捉表格数据非线性特征,兼顾统计严谨性与透明度。

Interpretable Feature Interaction via Statistical Self-supervised Learning on Tabular Data

  • 结合核主成分与稀疏多项式表示,实现非线性特征提取
  • 通过多目标敲除选择法控制假发现率,保证统计可靠性
  • 适合需要高透明度和严格统计保障的金融、医疗场景

在高维且高风险的应用中,如何在复杂表格数据中实现兼具严格统计保证与可解释性的特征提取仍是重大挑战。传统方法如主成分分析(PCA)依赖线性假设,而神经网络虽能无假设提取特征,但可解释性差。本文提出Spofe,一种新型自监督学习流程:首先利用核主成分生成自监督信号以建模复杂模式;其次将信号提炼为稀疏多项式函数提升可解释性;最后采用多目标敲除选择法进行显著性检验,严格控制假发现率(FDR)。该框架在回归与分类任务中持续优于KPCA、SKPCA等方法,在多个真实数据集上表现优异。可视化与案例研究验证了其揭示关键特征的能力,显著增强模型透明度与实用性。

原文摘要 · Abstract (English)

In high-dimensional and high-stakes contexts, ensuring both rigorous statistical guarantees and interpretability in feature extraction from complex tabular data remains a formidable challenge. Traditional methods such as Principal Component Analysis (PCA) reduce dimensionality and identify key features that explain the most variance, but are constrained by their reliance on linear assumptions. In contrast, neural networks offer assumption-free feature extraction through self-supervised learning techniques such as autoencoders, though their interpretability remains a challenge in fields requiring transparency. To address this gap, this paper introduces Spofe, a novel self-supervised machine learning pipeline that marries the power of kernel principal components for capturing nonlinear dependencies with a sparse and principled polynomial representation to achieve clear interpretability with statistical rigor. Underpinning our approach is a robust theoretical framework that delivers precise error bounds and rigorous false discovery rate (FDR) control via a multi-objective knockoff selection procedure; it effectively bridges the gap between data-driven complexity and statistical reliability via three stages: (1) generating self-supervised signals using kernel principal components to model complex patterns, (2) distilling these signals into sparse polynomial functions for improved interpretability, and (3) applying a multi-objective knockoff selection procedure with significance testing to rigorously identify important features. Extensive experiments on diverse real-world datasets demonstrate the effectiveness of Spofe, consistently surpassing KPCA, SKPCA, and other methods in feature selection for regression and classification tasks. Visualization and case studies highlight its ability to uncover key insights, enhancing interpretability and practical utility.

可解释性特征选择自监督学习统计保证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。