arXiv:2607.21781cs.DBcs.AI2026-07

用轻量级摘要快速发现数据列间语义关联,兼顾精度与速度。

MosaicJoin: Compact Semantic Sketches for Value-Level Join Discovery

  • 通过新型摘要技术避免全值比对,实现高基数列的高效匹配。
  • 在多个基准上超越已有方法,查询速度最快提升66倍。
  • 无需训练,支持超大列(最高57K/1M值),适合开放数据湖场景。

连接发现是数据集搜索的核心任务,用于识别可与给定查询列进行连接的列。早期方法聚焦等值连接,但数据湖和开放数据仓库中常存在同一实体的不同语法表达。近期方法虽能发现语义可连接列,却面临根本权衡:基于值级比较的方法准确但难以扩展至高基数列;基于列级嵌入的方法高效但忽略细粒度值对齐。本文提出MosaicJoin,一种平衡该权衡的值级语义连接发现方法。其通过新颖的摘要策略,在不比较所有值的前提下近似判断列对的可连接性。查询时,仅需按摘要大小成本计算候选摘要的可连接得分,使高基数列的检索依然高效。进一步引入查询子采样算子,在保证可证明准确性的前提下降低在线搜索时间,增强大查询列的鲁棒检索能力。大量实验表明,MosaicJoin在所有基准上均优于先前方法,且比其他值级方法快达66倍。MosaicJoin无需训练或微调,可稳健扩展至包含最多57,000个值的查询列和最多100万值的数据湖列。

原文摘要 · Abstract (English)

Join discovery is a core task in dataset search, enabling users to find columns that can be joined with a given query column. Early approaches focused on equi-joins, but data lakes and open-data repositories often contain columns whose values refer to the same entity but use different syntactic representations. To address this challenge, recent approaches discover semantically joinable columns but face a fundamental trade-off: methods that perform value-level comparisons accurately identify joinable columns but scale poorly to columns with high cardinality; column-level methods that encode an entire column into a single embedding are efficient but do not capture the fine-grained value alignment that determines whether a join is possible. We present MosaicJoin, a value-level semantic join discovery method that balances this trade-off. MosaicJoin achieves scalability through a novel sketching strategy that approximates the joinability of a column pair without having to compare all values. At query time, MosaicJoin scores each candidate sketch using a joinability score at a cost bounded by the sketch size, making retrieval efficient even for high-cardinality columns. A query subsampling operator further reduces online search time with provable accuracy guarantees, enabling robust retrieval for large query columns. Extensive experiments show that MosaicJoin outperforms previously published methods across all benchmarks while running up to 66 times faster than other value-level methods. MosaicJoin requires no training or fine-tuning, and it scales robustly to query columns containing up to 57K values and data lake columns containing up to 1M values.

数据搜索语义连接高效检索无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。