无需训练即可从噪声数据中精准估计随机微分方程的漂移与扩散函数。
In-Context Learning of Stochastic Differential Equations with Foundation Inference Models
- 基于预训练模型,直接从观测路径推断SDE的漂移和扩散项。
- 在合成与真实数据上均达到基准模型水平,且支持快速微调提升性能。
- 适合需要快速建模随机动态系统的研究者,如金融、气象等领域。
随机微分方程(SDE)描述了由漂移函数主导的确定性流与由扩散函数决定的随机扰动共同作用的动力系统。从数据中准确估计或发现这些函数是机器学习中的核心问题,广泛应用于自然科学与社会科学。然而现有方法要么依赖大量先验知识,要么需复杂训练流程。我们提出FIM-SDE(用于SDE的基座推断模型),一个预训练识别模型,可实现对低维SDE的漂移与扩散函数的准确上下文学习(或零样本)估计,仅需噪声时间序列数据,并支持针对目标数据集的快速微调。通过结合近似推断与神经算子思想,我们以监督方式在大量噪声离散观测的SDE路径上预训练该模型,使其映射至漂移与扩散函数空间。实验表明,FIM-SDE在多种合成与真实过程(如双阱动力学、弱扰动洛伦兹吸引子、股票价格记录、油价与风速波动)中均表现出稳健的上下文函数估计能力,性能媲美符号化、高斯过程及神经SDE基线模型(均在目标数据上训练)。当在目标过程上微调后,FIM-SDE始终优于所有基线模型。
原文摘要 · Abstract (English)
Stochastic differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with random fluctuations, dictated by a diffusion function. The accurate estimation (or discovery) of these functions from data is a central problem in machine learning, with wide application across the natural and social sciences. Yet current solutions either rely heavily on prior knowledge of the dynamics or involve intricate training procedures. We introduce FIM-SDE (Foundation Inference Model for SDEs), a pretrained recognition model that delivers accurate in-context (or zero-shot) estimation of the drift and diffusion functions of low-dimensional SDEs, from noisy time series data, and allows rapid finetuning to target datasets. Leveraging concepts from amortized inference and neural operators, we (pre)train FIM-SDE in a supervised fashion to map a large set of noisy, discretely observed SDE paths onto the space of drift and diffusion functions. We demonstrate that FIM-SDE achieves robust in-context function estimation across a wide range of synthetic and real-world processes -- from canonical SDE systems (e.g., double-well dynamics or weakly perturbed Lorenz attractors) to stock price recordings and oil-price and wind-speed fluctuations -- while matching the performance of symbolic, Gaussian process and Neural SDE baselines trained on the target datasets. When finetuned to the target processes, we show that FIM-SDE consistently outperforms all these baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。