arXiv:2601.15849cs.IR2026-01中稿 · The Web Conference…被引 1

用聚类生成多样部分表格,让大模型生成查询来提升表格检索效果。

CGPT: Cluster-Guided Partial Tables with LLM-Generated Supervision for Table Retrieval

  • 通过聚类选取跨语义的表格片段,增强覆盖多样性。
  • 利用大模型生成的查询进行对比学习,使嵌入模型在四个数据集上平均准确率提升16.54%。
  • 适合需要高精度表格检索的多领域应用,尤其适用于小模型生成监督信号场景。

通用嵌入模型在文本检索中表现良好,但在表格检索中因结构化内容导致语义压缩和查询-表格不匹配问题表现不佳。现有基于大模型的检索增强方法虽能生成合成查询,但多依赖启发式选择部分表格,且很少将合成查询用于优化嵌入模型。本文提出CGPT训练框架,通过K-means聚类表格实例并跨簇采样构建语义多样化的部分表格,再由大模型生成对应合成查询,并用于硬负样本对比微调嵌入模型。在四个公开基准(MimoTable、OTTQA、FetaQA、E2E-WTQ)上的实验表明,CGPT持续优于基线方法,平均R@1提升16.54%。在统一多领域语料设置下,CGPT展现出强跨域泛化能力,即使使用较小的大模型生成合成查询也保持有效。结果表明,语义引导的部分表格构建与大模型生成监督的对比训练构成一种高效可扩展的大规模表格检索范式。代码已开源。

原文摘要 · Abstract (English)

General-purpose embedding models have demonstrated strong performance in text retrieval but remain suboptimal for table retrieval, where highly structured content leads to semantic compression and query-table mismatch. Recent LLM-based retrieval augmentation methods mitigate this issue by generating synthetic queries, yet they often rely on heuristic partial-table selection and seldom leverage these synthetic queries as supervision to improve the embedding model. We introduce CGPT, a training framework that enhances table retrieval through LLM-generated supervision. CGPT constructs semantically diverse partial tables by clustering table instances using K-means and sampling across clusters to broaden semantic coverage. An LLM then generates synthetic queries for these partial tables, which are used in hard-negative contrastive fine-tuning to refine the embedding model. Experiments across four public benchmarks (MimoTable, OTTQA, FetaQA, and E2E-WTQ) show that CGPT consistently outperforms retrieval baselines, including QGpT, with an average R@1 improvement of 16.54 percent. In a unified multi-domain corpus setting, CGPT further demonstrates strong cross-domain generalization and remains effective even when using smaller LLMs for synthetic query generation. These results indicate that semantically guided partial-table construction, combined with contrastive training from LLM-generated supervision, provides an effective and scalable paradigm for large-scale table retrieval. Our code is available at https://github.com/yumeow0122/CGPT.

表格检索大模型监督对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。