用双图结构提升表格数据缺失值填补效果
Enhancing Missing Data Imputation through Combined Bipartite Graph and Complete Directed Graph
- 区分观测与特征为两类节点,用带属性边建模数据关系
- 在多种缺失机制下平均降低15%的均方误差
- 适合需要高精度填补和泛化能力的科研与工业场景
本文针对表格数据缺失值填补中的关键挑战——识别并利用特征间的依赖关系,提出一种名为双图与全向有向图神经网络(BCGNN)的新框架。该框架将观测样本与特征分别作为两类节点,将已观测特征值转化为连接它们的带属性边。其中,二分图部分通过归纳学习节点嵌入,高效利用带属性边中蕴含的完整信息;全向有向图部分则精准刻画并传递特征间的复杂依赖关系。实验表明,相较于现有主流填补方法,BCGNN在不同缺失机制下均表现更优,特征填补任务的平均均方误差降低15%。广泛实验证实,深入理解特征依赖结构能显著增强模型的特征表示能力,并在含缺失数据的标签预测任务中表现出色,且对未见数据点具备强大泛化能力。
原文摘要 · Abstract (English)
In this paper, we aim to address a significant challenge in the field of missing data imputation: identifying and leveraging the interdependencies among features to enhance missing data imputation for tabular data. We introduce a novel framework named the Bipartite and Complete Directed Graph Neural Network (BCGNN). Within BCGNN, observations and features are differentiated as two distinct node types, and the values of observed features are converted into attributed edges linking them. The bipartite segment of our framework inductively learns embedding representations for nodes, efficiently utilizing the comprehensive information encapsulated in the attributed edges. In parallel, the complete directed graph segment adeptly outlines and communicates the complex interdependencies among features. When compared to contemporary leading imputation methodologies, BCGNN consistently outperforms them, achieving a noteworthy average reduction of 15% in mean absolute error for feature imputation tasks under different missing mechanisms. Our extensive experimental investigation confirms that an in-depth grasp of the interdependence structure substantially enhances the model's feature embedding ability. We also highlight the model's superior performance in label prediction tasks involving missing data, and its formidable ability to generalize to unseen data points.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。