AI自研文本转SQL模型,通过自我进化提升性能。
RoboPhD: Self-Improving Text-to-SQL Through Autonomous Agent Evolution
- AI代理自动迭代优化,基于反馈演化出更优生成策略。
- 18轮进化后达73.67%准确率,对弱模型提升高达8.9点。
- 可实现降级部署:弱模型经演化后超越强模型基础版。
我们提出RoboPhD,一个让AI代理自主开展研究以提升文本转SQL性能的系统。该系统采用闭环演化循环,包含两个协同组件:由数据库分析脚本和生成指令组成的SQL生成代理,以及根据性能反馈设计新版本的演化代理。框架核心是基于ELO的筛选机制,支持适者生存动态并处理性能非传递性问题。从初始70行基线出发,RoboPhD通过迭代交叉繁殖,在无领域外部指导的情况下发现有效技术,如根据模式复杂度自适应调整分析深度、列选择与聚合的生成模式等。最佳代理历经18轮演化至1500行,相较于强基线Claude Opus 4.5提升2.3点,对弱模型Claude Haiku提升8.9点。这实现了‘跳级部署’:演化后的Haiku超越原生Sonnet,演化后的Sonnet超越原生Opus,且成本更低。系统在BIRD测试集上达到73.67%准确率,证明了仅需人类提供极简起点,AI即可自主构建高效智能体系统。
原文摘要 · Abstract (English)
We present RoboPhD, a system where AI agents autonomously conduct research to improve Text-to-SQL performance. RoboPhD implements a closed-loop evolution cycle with two coordinated components: a SQL Generation agent composed of a database analysis script and SQL generation instructions, and an Evolution agent that designs new versions based on performance feedback. Central to the framework is an ELO-based selection mechanism enabling survival-of-the-fittest dynamics while handling non-transitivity in performance. Starting from a naive 70-line baseline, RoboPhD evolves agents through iterative cross-pollination, discovering effective techniques without any external guidance on the Text-to-SQL domain. Our best agent, evolved to 1500 lines over 18 iterations, autonomously discovered strategies such as size-adaptive database analysis that adjusts depth based on schema complexity and SQL generation patterns for column selection, evidence interpretation, and aggregation. Evolution provides the largest gains on cheaper models: while we improve by 2.3 points over a strong Claude Opus 4.5 naive baseline, we show an improvement of 8.9 points over the weaker Claude Haiku model. This enables 'skip a tier' deployment: evolved Haiku exceeds naive Sonnet accuracy, and evolved Sonnet exceeds naive Opus, both at lower cost. The full system achieves 73.67% accuracy on the BIRD test set, demonstrating that AI can autonomously build a strong agentic system with only a trivial human-provided starting point.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。