arXiv:2605.18004cs.LG2026-05中稿 · ICML

用强化学习自动发现可解释的随机线性代数算法。

RL4RLA: Teaching ML to Discover Randomized Linear Algebra Algorithms Through Curriculum Design and Graph-Based Search

论文配图:RL4RLA: Teaching ML to Discover Randomized Linear Algebra Algorithms Through Curriculum Design and Graph-Based Search
图 1 · 摘自论文原文
  • 设计渐进式数值课程,引导算法搜索
  • 通过图搜索合并等效子算法,提升效率
  • 可定制精度-速度-稳定性的权衡策略

随机线性代数(RLA)算法是现代数值线性代数技术,在科学计算和机器学习中应用广泛且持续增长。然而其发现仍主要依赖人工,需深厚专业知识与灵感。尽管强化学习(RL)提供了自动化路径,但标准方法在稀疏奖励和庞大搜索空间下表现不佳。本文提出RL4RLA,一个通用的强化学习框架,用于自动化发现可解释、符号化的RLA算法。不同于黑箱方法,该方法从基础线性代数原语构建显式算法,确保可验证与可实现。为实现高效发现,引入:(1) 数值课程,逐步增加问题难度以编码特定于RLA领域的归纳偏置;(2) 蒙特卡洛图搜索,通过识别并合并等效的部分算法优化探索。实验表明,RL4RLA可复现最先进的方法,包括压缩预条件求解器、随机Kaczmarz和Newton Sketch,并能针对精度、速度与稳定性之间的特定权衡进行定向生成。代码已公开于https://github.com/Tim-Xiong/RL4RLA。

原文摘要 · Abstract (English)

Randomized linear algebra (RLA) algorithms are a modern class of numerical linear algebra techniques that play an essential role in scientific computing and machine learning, with broad and growing adoption. However, their discovery remains mostly a manual process that requires deep expert knowledge and inspiration. While Reinforcement Learning (RL) offers a pathway to automation, standard approaches struggle with sparse reward landscapes and vast search spaces inherent to high-performing RLA algorithms. In this paper, we present RL4RLA, a general RL framework that automates the discovery of interpretable, symbolic RLA algorithms. Unlike black-box approaches, our method builds explicit algorithms from basic linear algebra primitives, ensuring verifiable and implementable representations. To enable efficient discovery, we introduce: (1) a numerical curriculum that progressively increments problem difficulty to encode inductive bias specific to the RLA domain; (2) Monte Carlo Graph Search, which optimizes exploration by identifying and merging equivalent partial algorithms. We demonstrate that RL4RLA rediscovers state-of-the-art methods, including sketch-and-precondition solvers, Randomized Kaczmarz, and Newton Sketch, and can be targeted to produce algorithms optimized for specific trade-offs between accuracy, speed, and stability. Code is available at https://github.com/Tim-Xiong/RL4RLA.

强化学习算法发现线性代数符号化搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。