用多智能体分步解析表格,提升真实场景下电子表格的理解能力
Towards Robust Real-World Spreadsheet Understanding with Multi-Agent Multi-Format Reasoning

- 分两阶段处理:先构建结构草图,再针对任务推理
- 在Spreadsheet Bench上达38.16%准确率,优于基线2.89个百分点
- 适合需要高可靠性的企业报表、审计等实际应用
电子表格在企业报告、审计和科学数据管理中至关重要。现有基于大语言模型的方法通常将表格当作纯文本处理,忽略了布局线索和视觉语义。此外,真实场景中的表格规模庞大,超出大模型有效处理的输入长度。为此,我们提出SpreadsheetAgent,一种两阶段多智能体框架,采用逐步阅读与推理范式。不一次性加载整个表格,而是通过代码执行结果、图像和LaTeX表格等多种模态,逐步解析局部区域。第一阶段构建结构草图和行列摘要,第二阶段在中间表示上进行任务驱动推理。为增强可靠性,设计验证模块,通过定向检查校验提取结构,减少错误传播,确保下游推理输入可信。在两个电子表格数据集上的大量实验表明,使用GPT-OSS-120B时,SpreadsheetAgent在Spreadsheet Bench上达到38.16%的准确率,比ChatGPT Agent基线高出2.89个百分点。结果凸显了该方法在真实场景中实现鲁棒、可扩展表格理解的潜力。代码已公开于https://github.com/renhouxing/SpreadsheetAgent.git。
原文摘要 · Abstract (English)
Spreadsheets are central to real-world applications such as enterprise reporting, auditing, and scientific data management. Despite their ubiquity, existing large language model based approaches typically treat tables as plain text, overlooking critical layout cues and visual semantics. Moreover, real-world spreadsheets are often massive in scale, exceeding the input length that LLMs can efficiently process. To address these challenges, we propose SpreadsheetAgent, a two-stage multi-agent framework for spreadsheet understanding that adopts a step-by-step reading and reasoning paradigm. Instead of loading the entire spreadsheet at once, SpreadsheetAgent incrementally interprets localized regions through multiple modalities, including code execution results, images, and LaTeX tables. The method first constructs a structural sketch and row/column summaries, and then performs task-driven reasoning over this intermediate representation in the Solving Stage. To further enhance reliability, we design a verification module that validates extracted structures via targeted inspections, reducing error propagation and ensuring trustworthy inputs for downstream reasoning. Extensive experiments on two spreadsheet datasets demonstrate the effectiveness of our approach. With GPT-OSS-120B, SpreadsheetAgent achieves 38.16% on Spreadsheet Bench, outperforming the ChatGPT Agent baseline (35.27%) by 2.89 absolute points. These results highlight the potential of SpreadsheetAgent to advance robust and scalable spreadsheet understanding in real-world applications. Code is available at https://github.com/renhouxing/SpreadsheetAgent.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。