arXiv:2501.10667cs.LGstat.ML2025-01被引 1

PAIN动态适配多种数据类型,提升复杂缺失场景下的数据填补精度。

Precision Adaptive Imputation Network : An Unified Technique for Mixed Datasets

  • 融合统计、随机森林与自编码器的三步自适应填补策略
  • 在高维相关数据上优于均值、中位数及MissForest等方法
  • 适合处理非完全随机缺失的混合类型数据,适用于真实科研场景

缺失数据问题在多个科学领域仍具挑战性,亟需能应对复杂缺失模式的先进填补技术。本文提出精度自适应填补网络(PAIN),通过三步流程结合统计方法、随机森林与自编码器,动态适配不同数据类型、分布及缺失机制,实现精准高效的数据重建。在包含高维相关特征的多个数据集上进行严格评估,PAIN持续优于均值/中位数填补及MissForest等现有方法,尤其在非完全随机缺失场景下表现出更强的分布保持能力与分析完整性。该研究不仅深化了对缺失数据重构的理解,也为数据科学与机器学习中的方法创新提供了关键框架,推动混合型数据集在实际应用中的有效处理。

原文摘要 · Abstract (English)

The challenge of missing data remains a significant obstacle across various scientific domains, necessitating the development of advanced imputation techniques that can effectively address complex missingness patterns. This study introduces the Precision Adaptive Imputation Network (PAIN), a novel algorithm designed to enhance data reconstruction by dynamically adapting to diverse data types, distributions, and missingness mechanisms. PAIN employs a tri-step process that integrates statistical methods, random forests, and autoencoders, ensuring balanced accuracy and efficiency in imputation. Through rigorous evaluation across multiple datasets, including those characterized by high-dimensional and correlated features, PAIN consistently outperforms traditional imputation methods, such as mean and median imputation, as well as other advanced techniques like MissForest. The findings highlight PAIN's superior ability to preserve data distributions and maintain analytical integrity, particularly in complex scenarios where missingness is not completely at random. This research not only contributes to a deeper understanding of missing data reconstruction but also provides a critical framework for future methodological innovations in data science and machine learning, paving the way for more effective handling of mixed-type datasets in real-world applications.

数据填补混合数据自适应模型缺失机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。