用随机特征+微分方程构建高效时序模型,无需显式计算路径签名。
Random Controlled Differential Equations
- 用随机参数化微分方程作连续时间储备池,仅训练线性读出层。
- 在多个时序基准上达到竞争性或领先性能,优于传统签名方法。
- 适合需要高效且保留路径结构信息的时序建模任务。
我们提出一种高效的时序学习框架,结合随机特征与受控微分方程(CDEs)。大型随机参数化的CDE作为连续时间储备池,将输入路径映射为丰富表征,仅需训练线性读出层,实现快速可扩展的模型并具备强归纳偏置。在此基础上,提出两种变体:(i) 随机傅里叶CDE(RF-CDEs):在动力学前用随机傅里叶特征提升输入信号,提供RBF增强序列模型的无核近似;(ii) 随机粗糙微分方程(R-RDEs):通过对数-欧拉离散化直接作用于粗糙路径输入,使用对数签名捕捉高阶时间交互,同时保持稳定与高效。我们证明,在无限宽度极限下,这两种模型分别诱导出RBF提升的签名核与粗糙签名核,统一了随机特征储备池、连续时间深度架构与路径签名理论。在多个时序基准上评估,两者均表现优异,为显式签名计算提供了实用替代方案,既保留其归纳偏置,又受益于随机特征的效率。
原文摘要 · Abstract (English)
We introduce a training-efficient framework for time-series learning that combines random features with controlled differential equations (CDEs). In this approach, large randomly parameterized CDEs act as continuous-time reservoirs, mapping input paths to rich representations. Only a linear readout layer is trained, resulting in fast, scalable models with strong inductive bias. Building on this foundation, we propose two variants: (i) Random Fourier CDEs (RF-CDEs): these lift the input signal using random Fourier features prior to the dynamics, providing a kernel-free approximation of RBF-enhanced sequence models; (ii) Random Rough DEs (R-RDEs): these operate directly on rough-path inputs via a log-ODE discretization, using log-signatures to capture higher-order temporal interactions while remaining stable and efficient. We prove that in the infinite-width limit, these model induces the RBF-lifted signature kernel and the rough signature kernel, respectively, offering a unified perspective on random-feature reservoirs, continuous-time deep architectures, and path-signature theory. We evaluate both models across a range of time-series benchmarks, demonstrating competitive or state-of-the-art performance. These methods provide a practical alternative to explicit signature computations, retaining their inductive bias while benefiting from the efficiency of random features.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。