arXiv:2607.06233cs.AI2026-07中稿 · VLDB 2026

用强化学习生成企业级数据代理轨迹,提升模型泛化能力。

Demonstrating TOFFEE: A Learned System for Synthesizing Data Agent Trajectories at Scale

论文配图:Demonstrating TOFFEE: A Learned System for Synthesizing Data Agent Trajectories at Scale
图 1 · 摘自论文原文
  • 基于MCTS与自适应模型选择,自动合成复杂分析流程。
  • 生成轨迹可作微调数据或上下文示范,适配不同企业环境。
  • 支持端到端应用,适合需要数据代理训练的工程师。

由大语言模型驱动的数据代理在数据驱动决策中日益重要。然而,现有数据代理难以泛化至未见的数据环境和分析流程,尤其在异构企业场景中。这催生了对高质量数据代理轨迹合成的需求,以捕捉复杂分析工作流。此类轨迹可用于两个关键下游任务:作为监督微调(SFT)数据,使数据代理模型适配目标领域;或作为上下文学习(ICL)示范,引导通用大模型在陌生数据环境中推理。为此,我们提出TOFFEE系统,通过蒙特卡洛树搜索(MCTS)结合自适应模型选择与跨任务前缀复用,从给定数据环境中合成高质量数据代理轨迹。实验表明,TOFFEE能有效生成适用于复杂分析任务的可扩展轨迹数据。本演示展示其系统框架,包括任务池构建、轨迹探索器及学习成本模型,并介绍其网页界面与工作流。我们还演示了两个端到端场景:用于数据代理微调的轨迹合成,以及示范增强的数据代理推理。

原文摘要 · Abstract (English)

LLM-powered data agents are playing an increasingly important role in data-driven decision making. However, existing data agents struggle to generalize to unseen data environments and analytical workflows, especially in heterogeneous enterprise settings. This creates a growing need for synthesizing high-quality data agent trajectories that capture complex analytical workflows for given data environments. Such trajectories support two key downstream uses: they can serve as supervised finetuning (SFT) data that adapts data agent models to the target domain, and as in-context learning (ICL) demonstrations to guide general-purpose LLMs in unfamiliar data environments. Thus, we introduce TOFFEE, a system for synthesizing high-quality data agent trajectories from given data environments via Monte Carlo Tree Search (MCTS) with adaptive model selection and cross-task prefix reuse. We show that TOFFEE can effectively generate scalable trajectory data for complex analytical tasks across heterogeneous environments. In this demonstration, we present the system framework of TOFFEE, including its task pool construction, trajectory explorer, and learned cost model. We also introduce the web interface of TOFFEE and its workflow, and demonstrate two end-to-end scenarios: trajectory synthesis for data agent finetuning, and demonstration-augmented data agent reasoning.

数据代理轨迹生成MCTSLLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。