arXiv:2608.31082cs.AIcs.CL2026-08

让AI在回答问题时自动整理文档,节省大量计算成本。

Token-Efficient Data Reasoning Agents via Adaptive Structuring of Unstructured Data

论文配图:Token-Efficient Data Reasoning Agents via Adaptive Structuring of Unstructured Data
图 1 · 摘自论文原文
  • 边推理边自动提取结构化信息,基于实际问题动态生成
  • 在FanOutQA上降低53%的令牌消耗,保持准确率不变
  • 适合需要高效处理海量非结构化数据的企业级AI应用

有价值的数据深藏于网页、报告、合同、财报、电话会议记录和PDF等非结构化来源中。企业AI的未来在于部署大模型智能体,对这些数据进行推理以解答知识工作者的复杂问题。当前方法虽可行,但代价高昂:每次提问都要反复打开大文档查找零散证据,耗时可达百万令牌。若数据预先结构化,则只需廉价数据库查询即可完成。例如,在FanOutQA基准上,理想预结构化存储的推理成本仅为原始方法的1/28,且随着问题涉及文档数量增加,差距进一步扩大。然而预先结构化所有数据不可行:文档可能蕴含的结构远超实际使用需求,且哪些结构有用、对应哪些文档,只有在查询到来后才可知。本文提出「智能体数据解构」方法,将非结构化数据的结构化过程作为推理的副产品,自适应且前瞻地完成。结构化由实际查询驱动,决定何时进行及关注什么;同时前瞻性扩展至未来可能的相关查询。每当智能体为回答问题打开文档时,一个解构子智能体即从已加载上下文中以极低额外成本分叉,提取可能服务于后续相关查询的可信结构化信息。长期来看,越来越多的问题可完全由结构化数据直接回答,无需再次打开文档,从而维持接近RAG的成本水平,同时保持推理准确性。在仅增加每测试问题一个相关问题的前提下,该方法在FanOutQA上将成本降低53%,并保留原有准确率。这是迈向下一代面向非结构化数据的智能体推理基础设施的第一步——一个位于模型之下的共享知识基底,积累智能体已付出代价揭示的知识。

原文摘要 · Abstract (English)

Valuable data remains embedded in unstructured sources: web pages, reports, contracts, filings, earnings calls, and PDFs. The big bet in enterprise AI is deploying LLM agents that reason over this data to answer complex questions for every knowledge worker. Agents can do this today, but at prohibitive cost. Each question repeatedly opens large documents to recover scattered evidence, consuming up to a million tokens. However, if the data were already structured, the same question would reduce to a cheap database lookup. For example, on FanOutQA benchmark, reasoning over an ideal pre-structured store is 28X cheaper, and the gap grows to orders of magnitude as questions fan out over more documents. Yet structuring everything in advance is not viable: documents hold vastly more possible structure than any workload will use, and the useful structure and documents are unknown until queries arrive. We propose agentic data cracking, a method that structures unstructured data adaptively and speculatively as a byproduct of reasoning itself. Structuring is adaptive because observed queries decide when it happens and what matters, and speculative because it goes beyond the current question. Whenever the agent opens a document to answer, a cracking sub-agent forks from the already-loaded context at marginal cost and extracts grounded structure likely to serve related future queries. Over time, an increasing share of queries is fully covered by structured data and answered without opening a document, keeping agentic accuracy at close to RAG cost. On FanOutQA, extended with merely one related question per test question, cracking cuts cost by 53% while preserving accuracy. Agentic data cracking is a first step toward next-generation data infrastructure for agentic reasoning over unstructured data: a shared substrate beneath the model where knowledge that reasoning already paid to uncover accumulates.

智能体数据结构化成本优化非结构化数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。