arXiv:2602.08793cs.CLcs.DB2026-02

用知识分解方法,让表格类型标注模型跨数据湖快速适应,少标数据也能高精度。

LakeHopper: Knowledge-Aware Adaptation of Column Type Annotators across Data Lakes

  • 将标注模型的知识分为可复用、需调整和专有三类,指导高效迁移。
  • 仅用不到6%的目标标注数据,就达到接近全量训练的准确率,最高提升71.4%。
  • 适合数据标注成本高的场景,尤其对资源有限但需跨湖部署的团队有用。

列类型标注(CTA)为表列分配语义类型,是数据湖中数据集成、清洗与检索的基础。当前先进方法基于预训练语言模型(PLM),在特定数据湖上微调,但迁移到新湖时性能骤降,因表结构与类型集合均不同。重新训练每湖代价高昂,需大量专家标注。本文将跨湖适配视为知识管理问题,明确分解:相对于目标模型,源模型持有需舍弃(源特有)、需对齐复用(共享)或需获取(目标特有)的知识。该分解揭示通用大模型能弥补的部分与必须依赖目标监督的部分。基于此,提出LakeHopper,以固定标注预算适配源标注器,包含三项协同机制:标签集对齐(移植共享类型的输出层)、LLM验证的差距发现(定位预测不可靠的列)、基于聚类的传播与重训(将标记列泛化成批次且不丢失共享知识)。将LLM作为自身预测的验证者而非标注者,确保输出始终在目标类型集中,避免提示式大模型出现2.7%-47.6%的幻觉类型。在三个难度不同的数据湖迁移任务中,LakeHopper使三种PLM骨干网络宏F1提升最高达71.4%,仅用不足6%目标标签即逼近全量数据表现,且训练速度比微调表型大模型快27-131倍。

原文摘要 · Abstract (English)

Column Type Annotation (CTA), which assigns a semantic type to a table column, underpins data integration, cleaning, and search over data lakes. State-of-the-art annotators are pre-trained language models (PLMs) fine-tuned on one particular corpus of tables, i.e., a source data lake, and they degrade sharply once deployed on a new (i.e., target) lake, whose tables and semantic type set both differ. Retraining per lake is prohibitive because it demands large volumes of expert annotations. We recast cross-lake adaptation as a knowledge management problem and make the resulting decomposition explicit: relative to a target annotator, a source annotator holds knowledge that must be discarded (source-specific), realigned and reused (shared), or acquired (target-specific). This decomposition exposes which part of the gap a general-purpose LLM can close and which part only target supervision can. Guided by it, we present LakeHopper, which adapts a source annotator under a fixed annotation budget through three coupled mechanisms: label-set realignment that transplants the output layer for shared types, LLM-verified gap discovery that localizes columns the annotator handles unreliably, and cluster-based propagation plus rehearsal fine-tuning that generalizes each flagged column into a labeling batch without erasing shared knowledge. Casting the LLM as a verifier of the annotator's own predictions rather than an annotator keeps every output inside the target type set, so LakeHopper structurally emits no out-of-domain labels, whereas prompted LLMs hallucinate types on 2.7-47.6% of columns. Across three data lake transfers of differing difficulty, LakeHopperlifts three PLM backbones by up to 71.4% relative macro-F1, reaches near-full-data quality with under 6% of the target labels, and matches fine-tuned table LLMs while training 27-131 times faster.

知识迁移表格标注小样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。