arXiv:2606.09578cs.AIcs.CL2026-06

对比不同表格格式对大模型理解能力的影响,发现格式选择显著影响性能。

TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs

论文配图:TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs
图 1 · 摘自论文原文
  • 构建统一内容的多格式表格基准,控制变量评估表示方式差异。
  • 结构化文本优于图像,HTML表现最稳定,任务类型影响效果差距。
  • 适合关注表格理解、模型评测与格式敏感性的研究者参考。

大型语言模型(LLMs)和视觉-语言模型(VLMs)在表格推理任务上的评估日益增多,但表格表示形式的作用仍被忽视。实际中,同一表格内容可能以HTML、Markdown、LaTeX等结构化文本或渲染图像形式呈现,而现有评估常使内容、格式、布局和模态同时变化,难以分离表示的影响。为此,我们提出TABVERSE,一个受控的多模态表格理解基准,将相同表格内容映射到多种结构格式及渲染图像,并附带问题类别与难度标签。该设计支持在固定内容下系统评估表示效应。我们在三项任务上评估了LLMs和VLMs:问答(QA)、结构理解能力(SUC)和结构重建(SR)。结果表明,表示形式对表格理解有显著影响:模型在结构化文本上表现普遍优于渲染图像,但差距大小取决于任务、模型和格式;HTML通常最具鲁棒性,而行敏感的结构任务与语法可用的LaTeX重建仍具挑战性。这些发现表明,表格表示是可靠评估的关键因素。

原文摘要 · Abstract (English)

Large Language Models (LLMs) and Vision-Language Models (VLMs) are increasingly evaluated on table reasoning tasks, but the role of table representation remains under-explored. In practice, the same table content may appear in different structural formats, such as HTML, Markdown, and LaTeX, or as rendered images. However, existing evaluations often let content, format, layout, and modality vary together, making it difficult to isolate representation effects. We introduce TABVERSE, a controlled multimodal table benchmark that aligns the same table content across multiple structural formats and rendered images, with question category and difficulty tags. This design enables systematic evaluation of representation effects while holding table content fixed. We evaluate LLMs and VLMs across three tasks: Question Answering (QA), Structural Understanding Capability (SUC), and Structure Reconstruction (SR). Our results show that representation choice substantially affects table understanding. Models generally perform better with structured text than with rendered images, but the size of this gap depends on the task, model, and format. HTML is often the most robust text format, while row-sensitive structural tasks and syntactically usable LaTeX reconstruction remain challenging. These findings show that table representation is a key factor in reliable table evaluation.

表格理解模型评测多模态表示学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。