统一实现多种线性RNN架构,降低研究门槛。
$\texttt{lrnnx}$: A library for Linear RNNs
- 提供统一接口,支持多种LRNN模型与核心组件
- 兼容不同框架,避免自定义CUDA内核依赖
- 适合想快速实验或扩展线性RNN的研究者
线性循环神经网络(LRNN)通过结构化设计,将经典线性动态系统与现代深度学习结合,兼具表达能力与稳定性和可训练性的理论保证。近年来,已有多种基于LRNN的架构被提出,各自采用不同的参数化方式、离散化方案和实现约束。然而现有实现分散于不同软件框架中,常依赖特定框架优化,部分需自定义CUDA内核,甚至缺乏公开代码,导致使用、比较或扩展LRNN需大量开发工作。为此,我们推出《lrnnx》——一个统一的软件库,实现了多个现代LRNN架构,并提供统一接口。该库支持从底层组件到高层模型抽象的多层级控制,旨在提升LRNN研究与应用的可访问性、可复现性与可扩展性。代码以宽松的MIT许可证开源。
原文摘要 · Abstract (English)
Linear recurrent neural networks (LRNNs) provide a structured approach to sequence modeling that bridges classical linear dynamical systems and modern deep learning, offering both expressive power and theoretical guarantees on stability and trainability. In recent years, multiple LRNN-based architectures have been proposed, each introducing distinct parameterizations, discretization schemes, and implementation constraints. However, existing implementations are fragmented across different software frameworks, often rely on framework-specific optimizations, and in some cases require custom CUDA kernels or lack publicly available code altogether. As a result, using, comparing, or extending LRNNs requires substantial implementation effort. To address this, we introduce $\texttt{lrnnx}$, a unified software library that implements several modern LRNN architectures under a common interface. The library exposes multiple levels of control, allowing users to work directly with core components or higher-level model abstractions. $\texttt{lrnnx}$ aims to improve accessibility, reproducibility, and extensibility of LRNN research and applications. We make our code available under a permissive MIT license.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。