arXiv:2411.02059cs.LGcs.AI2024-11被引 82

让大模型真正读懂表格数据,提升分析与问答能力。

TableGPT2: A Large Multimodal Model with Tabular Data Integration

  • 自研表格编码器,精准捕捉表结构与单元格信息。
  • 在23项基准测试中,72B模型性能提升49.32%。
  • 适合需要处理真实复杂表格的业务分析场景。

GPT、Claude、LLaMA、Qwen等大模型的兴起重塑了人工智能应用,但表格数据的整合仍严重不足,而这在数据库集成、数据分析和商业智能等领域至关重要。为此,我们提出TableGPT2,基于超过593.8K张表格和2.36M高质量查询-表格-输出三元组进行预训练与微调,规模远超以往研究。该模型在保持强大通用语言与代码能力的同时,显著提升表格任务表现。其核心创新在于专为表格设计的编码器,可有效处理列名缺失、表结构不规则等现实问题。类似视觉语言模型,该架构实现多模态融合。在23个基准测试中,7B模型平均性能提升35.20%,72B模型提升49.32%,同时保留强泛化能力。

原文摘要 · Abstract (English)

The emergence of models like GPTs, Claude, LLaMA, and Qwen has reshaped AI applications, presenting vast new opportunities across industries. Yet, the integration of tabular data remains notably underdeveloped, despite its foundational role in numerous real-world domains. This gap is critical for three main reasons. First, database or data warehouse data integration is essential for advanced applications; second, the vast and largely untapped resource of tabular data offers immense potential for analysis; and third, the business intelligence domain specifically demands adaptable, precise solutions that many current LLMs may struggle to provide. In response, we introduce TableGPT2, a model rigorously pre-trained and fine-tuned with over 593.8K tables and 2.36M high-quality query-table-output tuples, a scale of table-related data unprecedented in prior research. This extensive training enables TableGPT2 to excel in table-centric tasks while maintaining strong general language and coding abilities. One of TableGPT2's key innovations is its novel table encoder, specifically designed to capture schema-level and cell-level information. This encoder strengthens the model's ability to handle ambiguous queries, missing column names, and irregular tables commonly encountered in real-world applications. Similar to visual language models, this pioneering approach integrates with the decoder to form a robust large multimodal model. We believe the results are compelling: over 23 benchmarking metrics, TableGPT2 achieves an average performance improvement of 35.20% in the 7B model and 49.32% in the 72B model over prior benchmark-neutral LLMs, with robust general-purpose capabilities intact.

表格理解大模型多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。