用BERT改进表格数据缺失值填补,更准且能算碳排放。
TREB: a BERT attempt for imputing tabular data imputation
- 用微调BERT模型直接补连续数值,利用上下文关系
- 在加州房价数据集上比传统方法更保特征关联性
- 首次量化模型训练部署的算力和碳足迹,适合关注效率者
TREB是一种新型表格数据填补框架,采用BERT模型实现对表格数据中缺失值的精准填补。与传统方法不同,TREB通过专门针对实值连续变量填补任务微调的BERT模型,充分挖掘语言模型潜力。该方法特别强调特征间的上下文关联性,有效保留数据内在结构。在加州房价数据集上的实验表明,TREB能准确恢复缺失值并维持特征间关系。研究还首次量化了模型训练与部署过程中的浮点运算量(FLOPs)和碳足迹,为评估模型环境影响提供依据。
原文摘要 · Abstract (English)
TREB, a novel tabular imputation framework utilizing BERT, introduces a groundbreaking approach for handling missing values in tabular data. Unlike traditional methods that often overlook the specific demands of imputation, TREB leverages the robust capabilities of BERT to address this critical task. While many BERT-based approaches for tabular data have emerged, they frequently under-utilize the language model's full potential. To rectify this, TREB employs a BERT-based model fine-tuned specifically for the task of imputing real-valued continuous numbers in tabular datasets. The paper comprehensively addresses the unique challenges posed by tabular data imputation, emphasizing the importance of context-based interconnections. The effectiveness of TREB is validated through rigorous evaluation using the California Housing dataset. The results demonstrate its ability to preserve feature interrelationships and accurately impute missing values. Moreover, the authors shed light on the computational efficiency and environmental impact of TREB, quantifying the floating-point operations (FLOPs) and carbon footprint associated with its training and deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。