让编码代理自动修复反例,确保规则不变且可追溯。
Agentic Synthesis against Counterexample-Supplemented Sketches

- 用反例补充的草图驱动智能代理修复代码缺陷。
- 8个失败案例经修正后全部通过测试,16/21未见案例也成功通过。
- 支持溯源与多人协作,防止错误策略被固化。
编码代理可在不破坏原有领域规则的前提下修复失败示例。本文提出一种基于反例增强草图的原生系统合成方法,其策略在实现过程中被发现。开发者从部分草图开始,编码代理生成可替换的投影。当仿真暴露缺失或错误策略时,操作员批准修正行为及最小通用规则。每次开发调用需声明变更权限,以及必须保留的规则、空缺、锚点和已批准行为。冲突或模糊授权将保持文件不变并生成澄清问题。完整存档保留溯源信息;精选回归集界定不同边界。在展示新候选前,当前案例与精选回归必须通过确定性输出对比和对当前草图的独立审查。定期重新生成测试草图是否承载学习到的策略。以CatSynth为例,在一次开放世界运行中,使用GPT-5.4-mini,14个冻结候选中有8个成为反例。修正协议后,重播全部、演化草图重建、保留草图-反例分别通过8个已接受案例中的14、17、16个未见案例。草图审查拒绝了过早的空输入和标签策略,恢复了丢失的锚点;裁决评审错误未转化为策略。单一模型与单一揭示顺序无法确立普遍正确性或优越性。在此套件中,第二轮检查揭示了仅靠确定性重播隐藏的漂移,经审查的草图比原始示例重播多通过3个未见案例。
原文摘要 · Abstract (English)
Coding agents can fix a failing example without preserving the domain rule that made it fail. We present agentic synthesis against counterexample-supplemented sketches, a repository-native method for systems whose policy is discovered during implementation. A human starts with a partial sketch, and a coding agent compiles a replaceable projection. When simulation exposes missing or mistaken policy, an operator approves the corrected behavior and the minimum general rule the case authorizes. Every Developer call names its change authority and the rules, holes, anchors, and approved behavior that must survive. Conflict or ambiguous permission leaves the files unchanged and produces a clarification question. A complete archive preserves provenance; a curated regression set gates distinct boundaries. Before another candidate is revealed, the active case and curated regressions must pass both deterministic approved-output comparison and a separate review against the current sketch. Periodic clean regeneration tests whether the sketch carries the learned policy. We demonstrate the method with CatSynth, a captured synthetic application. In one open-world run with GPT-5.4-mini, 8 of 14 frozen candidates became counterexamples. Under the corrected protocol, replay-all, evolved-sketch rebuild, and retained Sketch-CE each passed all 8 accepted cases. They passed 14, 17, and 16 of 21 withheld cases, respectively. Sketch review rejected premature empty-input and tag policies and restored dropped anchors; adjudicated reviewer errors did not become policy. One model and one reveal order cannot establish general correctness or superiority. On this suite, the second check exposed drift hidden by deterministic replay, and the reviewed sketch passed three more withheld cases than raw example replay.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。