用统计先验与神经注意力结合,实现可解释的混合类型数据补全。
Statistical-Neural Interaction Networks for Interpretable Mixed-Type Data Imputation
- 通过可控先验注意力模块融合统计相关性与神经特征学习。
- 在30%缺失率下连续变量表现稳健,分类变量略逊于顶尖模型。
- 内置依赖关系图谱,适合需要透明决策过程的场景。
真实世界表格数据库常混合连续变量与分类变量,但缺失值普遍存在且会扭曲下游分析。本文提出统计-神经交互(SNI)框架,将基于相关性的统计先验与神经特征注意力通过可控先验特征注意力(CPFA)模块耦合。CPFA学习头级别的先验强度系数{λ_h},在保持先验引导的同时允许数据驱动的非线性偏离。除补全外,SNI还生成有向特征依赖矩阵,揭示补全所依赖的变量关系,无需额外解释工具。在六种数据集(包括ICU监测、人口调查、社会经济统计和工程应用)上评估,覆盖MCAR/严格MAR条件下30%缺失率。在连续指标上表现相当,但在分类变量上常被以精度优先的基线(如MissForest、MIWAE)超越;作为交换,其提供内在依赖诊断与显式统计-神经权衡参数。此外报告了MNAR压力测试(使用掩码感知变体),并讨论计算成本、局限性(尤其是严重不平衡的分类目标)及解释性优先的部署场景。
原文摘要 · Abstract (English)
Real-world tabular databases routinely combine continuous measurements and categorical records, yet missing entries are pervasive and can distort downstream analysis. We propose Statistical-Neural Interaction (SNI), an interpretable mixed-type imputation framework that couples correlation-derived statistical priors with neural feature attention through a Controllable-Prior Feature Attention (CPFA) module. CPFA learns head-wise prior-strength coefficients $\{λ_h\}$ that softly regularize attention toward the prior while allowing data-driven deviations when nonlinear patterns appear to be present in the data. Beyond imputation, SNI aggregates attention maps into a directed feature-dependency matrix that summarizes which variables the imputer relied on, without requiring post-hoc explainers. We evaluate SNI against six baselines (Mean/Mode, MICE, KNN, MissForest, GAIN, MIWAE) on six datasets spanning ICU monitoring, population surveys, socio-economic statistics, and engineering applications. Under MCAR/strict-MAR at 30\% missingness, SNI is generally competitive on continuous metrics but is often outperformed by accuracy-first baselines (MissForest, MIWAE) on categorical variables; in return, it provides intrinsic dependency diagnostics and explicit statistical-neural trade-off parameters. We additionally report MNAR stress tests (with a mask-aware variant) and discuss computational cost, limitations -- particularly for severely imbalanced categorical targets -- and deployment scenarios where interpretability may justify the trade-off.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。