arXiv:2603.06503cs.CL2026-03被引 4

让AI能像人一样一步步分析复杂表格,支持跨表推理与编辑。

Beyond Rows to Reasoning: Agentic Retrieval for Multimodal Spreadsheet Understanding and Editing

  • 用迭代工具调用替代单次检索,实现多步推理。
  • 在三个基准上分别领先25、7、32个百分点,效果显著。
  • 适合需要精准表格分析与可审计操作的企业场景。

当前多模态检索增强生成(RAG)技术使大语言模型(LLM)能够处理包含数百万单元格、跨表依赖和嵌入式视觉元素的企业级电子表格。但现有方法存在单次检索遗漏关键上下文、压缩导致数据分辨率下降、全量注入超出LLM上下文窗口等问题,难以实现可靠多步推理。本文提出超越行的推理框架(BRTR),采用迭代工具调用循环,支持从复杂分析到结构化编辑的端到端Excel工作流。基于超200小时专家评估,BRTR在三个前沿表格理解基准上达到领先水平:在FRTR-Bench上超越前序方法25个百分点,在SpreadsheetLLM上提升7点,在FINCH上提升32点。评估了五种多模态嵌入模型,发现NVIDIA NeMo Retriever 1B在混合表格与视觉数据上表现最佳;测试了九种LLM,消融实验表明规划器、检索与迭代推理均贡献显著,成本分析显示GPT-5.2在效率与准确率间取得最优平衡。所有评估中,BRTR通过显式的工具调用日志保持全程可审计性。

原文摘要 · Abstract (English)

Recent advances in multimodal Retrieval-Augmented Generation (RAG) enable Large Language Models (LLMs) to analyze enterprise spreadsheet workbooks containing millions of cells, cross-sheet dependencies, and embedded visual artifacts. However, state-of-the-art approaches exclude critical context through single-pass retrieval, lose data resolution through compression, and exceed LLM context windows through naive full-context injection, preventing reliable multi-step reasoning over complex enterprise workbooks. We introduce Beyond Rows to Reasoning (BRTR), a multimodal agentic framework for spreadsheet understanding that replaces single-pass retrieval with an iterative tool-calling loop, supporting end-to-end Excel workflows from complex analysis to structured editing. Supported by over 200 hours of expert human evaluation, BRTR achieves state-of-the-art performance across three frontier spreadsheet understanding benchmarks, surpassing prior methods by 25 percentage points on FRTR-Bench, 7 points on SpreadsheetLLM, and 32 points on FINCH. We evaluate five multimodal embedding models, identifying NVIDIA NeMo Retriever 1B as the top performer for mixed tabular and visual data, and vary nine LLMs. Ablation experiments confirm that the planner, retrieval, and iterative reasoning each contribute substantially, and cost analysis shows GPT-5.2 achieves the best efficiency-accuracy trade-off. Throughout all evaluations, BRTR maintains full auditability through explicit tool-call traces.

表格理解多模态智能编辑可审计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。