用统计特征向量化表格数据,实现跨数据集相似性匹配与可解释对齐。
Statistical Embeddings for Similarity, Retrieval, and Interpretable Alignment of Numeric Tabular Datasets

- 基于探索性分析特征生成向量,通过句子嵌入模型对齐异构数据
- 跨数据集检索准确率达90%,在隐私保护下仍保持结构鲁棒性
- 无需共享变量名即可发现关键变量对应关系,适合科学数据分析
数值型表格数据是科学实践中主流的数据格式,但大语言模型缺乏在异构特征空间中对这类数据进行有意义表示的原生机制。现有方法要么依赖共享变量定义进行预测建模,要么缺乏可解释的跨数据集对齐能力。本文提出的方法通过结构化探索性数据分析描述符表征数值表格数据,利用预训练句子变换器将这些描述符嵌入共享向量空间,并通过典型相关分析(CCA)量化跨数据集相似性。进一步采用带惩罚项的CCA恢复稀疏、可解释的变量级对应关系,识别驱动跨数据集对齐的关键统计特征或变量级量值,无需共享变量名或特征规范。在嵌入前对描述符集应用差分隐私,支持在敏感数据场景下部署而无需访问原始观测数据。在15个涵盖通用基准、材料信息学和核级石墨表征的数据集上评估,总P@1得分为0.9,已知最近邻检索与聚类结构在嵌入消融及差分隐私预算下均保持稳健。该框架为将异构数值数据整合进检索增强生成流程提供了理论路径,同时保留统计上下文,直接应用于未知数据集的算法选择与模拟模型初始化。
原文摘要 · Abstract (English)
Numeric tabular datasets are the dominant data format in scientific practice, yet large language models lack native mechanisms for representing numeric datasets in a meaningful way across heterogeneous feature spaces. Existing approaches either target predictive modeling over individual datasets, which requires a shared set of variable definitions, or lack mechanisms for interpretable cross-dataset alignment. The proposed methodology characterizes numeric tabular datasets through structured exploratory data analysis descriptors, embeds those descriptors into a shared vector space using a pretrained sentence transformer, and quantifies cross-dataset similarity via Canonical Correlation Analysis (CCA). Furthermore, a penalized formulation of CCA is applied to recover sparse, interpretable variable-level correspondences between datasets, identifying which statistical descriptors or variable-level quantities drive cross-dataset alignment without requiring shared variable names or feature conventions. Differential privacy is optionally applied to the descriptor set prior to embedding, supporting deployment in sensitive data contexts without requiring access to raw observations at time of comparison. The methodology is evaluated across 15 datasets spanning general-purpose benchmarks, materials informatics, and nuclear-grade graphite characterization. Results demonstrate a total P@1 score of 0.9, with known nearest-neighbor retrieval and cluster structure remaining robust across embedding ablations and differential privacy budgets. The proposed framework provides a principled pathway for integrating heterogeneous numeric data into retrieval-augmented generation pipelines while preserving statistical context, with direct applications to data-driven algorithm selection and simulation model initialization for unknown datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。