用逻辑生成可验证的任务数据,让大模型更可靠地完成复杂目标。
LOGIGEN: Logic-Driven Generation of Verifiable Agentic Tasks
- 基于逻辑规则自动构造带约束的复杂任务环境
- 生成2万条跨8领域的可验证任务,成功率79.5%
- 适合研究智能体训练与可信决策的开发者
大型语言模型从静态指令执行者演变为自主智能体,需在复杂状态环境中达成精确的状态转移目标。然而,当前方法受限于数据稀缺,工具导向的逆向合成流程无法捕捉真实应用中的严格逻辑。本文提出LOGIGEN框架,通过三大核心机制:硬编码策略锚定、逻辑驱动正向合成、确定性状态验证。采用三智能体协同架构:架构师将自然语言策略转化为数据库约束以强制规则;设计者初始化边界邻近状态以触发关键策略冲突;探索者在此环境中搜索因果解路径。该框架生成20,000个跨8个领域的复杂任务数据集,通过精确状态等价性验证确保有效性。此外,提出基于验证的训练协议:在可验证轨迹上进行监督微调(SFT)以保证符合硬编码策略,再结合密集状态奖励的强化学习(RL)优化长时程目标达成能力。在τ²-Bench测试中,LOGIGEN-32B(RL)达到79.5%的成功率,显著优于基础模型的40.7%。结果表明,逻辑驱动合成与验证训练相结合,能有效构建下一代智能体所需的因果有效轨迹。
原文摘要 · Abstract (English)
The evolution of Large Language Models (LLMs) from static instruction-followers to autonomous agents necessitates operating within complex, stateful environments to achieve precise state-transition objectives. However, this paradigm is bottlenecked by data scarcity, as existing tool-centric reverse-synthesis pipelines fail to capture the rigorous logic of real-world applications. We introduce \textbf{LOGIGEN}, a logic-driven framework that synthesizes verifiable training data based on three core pillars: \textbf{Hard-Compiled Policy Grounding}, \textbf{Logic-Driven Forward Synthesis}, and \textbf{Deterministic State Verification}. Specifically, a Triple-Agent Orchestration is employed: the \textbf{Architect} compiles natural-language policy into database constraints to enforce hard rules; the \textbf{Set Designer} initializes boundary-adjacent states to trigger critical policy conflicts; and the \textbf{Explorer} searches this environment to discover causal solution paths. This framework yields a dataset of 20,000 complex tasks across 8 domains, where validity is strictly guaranteed by checking exact state equivalence. Furthermore, we propose a verification-based training protocol where Supervised Fine-Tuning (SFT) on verifiable trajectories establishes compliance with hard-compiled policy, while Reinforcement Learning (RL) guided by dense state-rewards refines long-horizon goal achievement. On $τ^2$-Bench, LOGIGEN-32B(RL) achieves a \textbf{79.5\% success rate}, substantially outperforming the base model (40.7\%). These results demonstrate that logic-driven synthesis combined with verification-based training effectively constructs the causally valid trajectories needed for next-generation agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。