FACET让终端任务生成更可靠,确保指令、环境、解法一致。
FACET: Preserving Source Intent and Executable State in Terminal Task Synthesis

- 分步重建技能场景,用共享执行状态统一任务各组件
- 在真实执行中验证并修复错误,避免无效重生成
- 适合需要高可靠性终端训练的AI智能体研究者
训练终端智能体需要可扩展的可执行监督,但高质量终端任务的合成仍具挑战。每个任务包含指令、初始化环境、参考解法和可执行验证器;若这些组件基于不一致假设生成,任务可能不可解或评估错误。多阶段合成还可能丢失原始来源中的目标、依赖、状态转移和过程约束。我们提出FACET(细粒度智能体式可执行任务构建),解决信息保留与跨组件一致性问题。FACET将相关智能体技能重构为连贯的信息丰富场景,先实现并修复执行环境,再生成最终任务组件。生成的容器状态作为指令、解法和验证器的共享基础,基于执行的验证与针对性修复可纠正特定组件失败,而无需重新生成有效部分。FACET生成具有密集可执行检查的复杂终端任务,由此收集的成功轨迹提供高效监督。在Terminal-Bench 2.1上,不同规模微调均持续提升性能;对替代生成方案的分析也支持以环境为基础的构建对任务有效性与解法-验证器对齐的重要性。这些结果确立源意图保持与共享可执行状态基底为可扩展终端任务合成的关键原则。
原文摘要 · Abstract (English)
Training terminal agents requires scalable executable supervision, yet synthesizing high-quality terminal tasks remains challenging. Each task couples an instruction, an initialized environment, a reference solution, and an executable verifier; if these artifacts are generated from inconsistent assumptions, the resulting task may be unsolvable or incorrectly evaluated. Meanwhile, multi-stage synthesis can discard the goals, dependencies, state transitions, and procedural constraints encoded in the original sources. We present FACET (Fine-grained Agentic Construction of Executable Tasks), a framework that addresses both information preservation and cross-artifact consistency. FACET reconstructs related agent skills into coherent, information-rich scenarios, then realizes and repairs the execution environment before generating the final task artifacts. The resulting container state serves as shared grounding for the instruction, solution, and verifier, while execution-based validation and targeted repair correct artifact-specific failures without unnecessarily regenerating valid components. FACET produces complex terminal tasks with dense executable checks, and successful trajectories collected from these tasks provide effective, data-efficient supervision. Fine-tuning models across multiple scales consistently improves performance on Terminal-Bench 2.1, while analyses of alternative generation schemes support the importance of environment-grounded construction for task validity and solution-verifier alignment. These results establish source-intent preservation and shared executable-state grounding as key principles for scalable terminal-task synthesis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。