arXiv:2510.06189cs.AI2025-10被引 55

AI可自动发现性能更优的系统算法,显著提升云调度等场景效率。

Barbarians at the Gate: How AI is Upending Systems Research

  • 用AI生成并验证系统算法,通过实际运行测试性能来筛选最优解。
  • 在多区域云调度等任务中,新算法比人工设计快5倍或成本降50%。
  • 适合关注算法自动化、系统优化的研究者与工程师参考。

人工智能正开始重塑研究范式,通过自动化发现新解决方案。典型方法是先生成多样解,再通过可靠验证器筛选出有效解。我们提出面向系统研究的AI驱动研究(ADRS),其核心在于利用真实系统或模拟器运行算法并测量性能作为验证依据。基于开源工具penEvolve,我们在多区域云调度、专家混合推理、基于大模型的SQL查询及事务调度等场景中开展案例研究,发现部分算法性能超越现有最优人工设计,最高实现5.0倍运行时间降低或50%成本节约。文章提炼了从提示设计到评估器构建的最佳实践,并指出随着AI在算法设计中的主导作用增强,研究人员将更多聚焦于问题定义与战略指导。这揭示了AI时代系统研究的颠覆性潜力与变革紧迫性。

原文摘要 · Abstract (English)

Artificial Intelligence (AI) is starting to transform the research process as we know it by automating the discovery of new solutions. Given a task, the typical AI-driven approach is (i) to generate a set of diverse solutions, and then (ii) to verify these solutions and select one that solves the problem. Crucially, this approach assumes the existence of a reliable verifier, i.e., one that can accurately determine whether a solution solves the given problem. We argue that systems research, long focused on designing and evaluating new performance-oriented algorithms, is particularly well-suited for AI-driven solution discovery. This is because system performance problems naturally admit reliable verifiers: solutions are typically implemented in real systems or simulators, and verification reduces to running these software artifacts against predefined workloads and measuring performance. We term this approach as AI-Driven Research for Systems (ADRS), which iteratively generates, evaluates, and refines solutions. Using penEvolve, an existing open-source ADRS instance, we present case studies across diverse domains, including load balancing for multi-region cloud scheduling, Mixture-of-Experts inference, LLM-based SQL queries, and transaction scheduling. In multiple instances, ADRS discovers algorithms that outperform state-of-the-art human designs (e.g., achieving up to 5.0x runtime improvements or 50% cost reductions). We distill best practices for guiding algorithm evolution, from prompt design to evaluator construction, for existing frameworks. We then discuss the broader implications for the systems community: as AI assumes a central role in algorithm design, we argue that human researchers will increasingly focus on problem formulation and strategic guidance. Our results highlight both the disruptive potential and the urgent need to adapt systems research practices in the age of AI.

系统研究AI生成性能优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。