通过掩码引导学习缺失模式,提升数据补全精度。
M$^3$-Impute: Mask-guided Representation Learning for Missing Value Imputation
- 构建双部图模型,用图神经网络融合缺失信息初始化嵌入。
- 在25个数据集上平均MAE表现最佳,3种缺失场景下均领先。
- 适合处理含复杂相关性的高维缺失数据补全任务。
缺失值是数据分析与机器学习中的常见问题,亟需有效填补方法以提升数据质量。现有方法未在嵌入初始化阶段显式利用缺失信息,也未能充分建模特征与样本间的纠缠关联,导致性能受限。本文提出M$^3$-Impute,通过新型掩码策略显式利用缺失模式,并构建双部图结构,结合图神经网络学习节点嵌入。嵌入初始化阶段直接融入缺失信息,再通过特征相关单元(FRU)与样本相关单元(SRU)优化表示,有效捕捉特征与样本间的关联。在25个基准数据集、三种缺失设置下的实验表明,该方法在平均MAE指标上取得20次最优、4次次优的结果。
原文摘要 · Abstract (English)
Missing values are a common problem that poses significant challenges to data analysis and machine learning. This problem necessitates the development of an effective imputation method to fill in the missing values accurately, thereby enhancing the overall quality and utility of the datasets. Existing imputation methods, however, fall short of explicitly considering the `missingness' information in the data during the embedding initialization stage and modeling the entangled feature and sample correlations during the learning process, thus leading to inferior performance. We propose M$^3$-Impute, which aims to explicitly leverage the missingness information and such correlations with novel masking schemes. M$^3$-Impute first models the data as a bipartite graph and uses a graph neural network to learn node embeddings, where the refined embedding initialization process directly incorporates the missingness information. They are then optimized through M$^3$-Impute's novel feature correlation unit (FRU) and sample correlation unit (SRU) that effectively captures feature and sample correlations for imputation. Experiment results on 25 benchmark datasets under three different missingness settings show the effectiveness of M$^3$-Impute by achieving 20 best and 4 second-best MAE scores on average.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。