用可变噪声学习时间序列,提升无监督表示能力
Self-Supervised Learning via Flow-Guided Neural Operator on Time-Series Data
- 将噪声强度设为可学习变量,动态调整数据污染程度
- 在脑电、皮肤温度等任务中实现最高35%的准确率提升
- 适合小样本场景,尤其医疗时间序列分析
自监督学习(SSL)是利用未标注时间序列数据的强大范式。现有方法如掩码自编码器(MAE)依赖固定掩码比例进行输入重建。本文提出将污染程度视为新自由度,提升模型灵活性与性能。为此,我们引入流引导神经算子(FGNO),结合算子学习与流匹配实现SSL训练。通过短时傅里叶变换统一不同时间分辨率,从多层网络与不同噪声时间点提取多层次特征,实现从低级模式到高级全局特征的统一建模。不同于以往生成式方法在推理时使用带噪输入,本方法在特征提取阶段使用干净输入,仅在训练时引入噪声,消除随机性并提高精度。我们在三个生物医学领域评估了FGNO,结果一致优于基线:在神经信号解码(BrainTreeBank)中,AUROC提升最高达35%;皮肤温度预测(DREAMT)中RMSE降低16%;在低数据条件下,睡眠分类(SleepEDF)准确率与宏平均F1提升超20%。这些结果表明FGNO对数据稀缺具有强鲁棒性,且具备捕捉多样化时间序列表达特征的能力。
原文摘要 · Abstract (English)
Self-supervised learning (SSL) is a powerful paradigm for learning from unlabeled time-series data. However, popular methods such as masked autoencoders (MAEs) rely on reconstructing inputs from a fixed, predetermined masking ratio. Instead of this static design, we propose treating the corruption level as a new degree of freedom for representation learning, enhancing flexibility and performance. To achieve this, we introduce the Flow-Guided Neural Operator (FGNO), a novel framework combining operator learning with flow matching for SSL training. FGNO learns mappings in functional spaces by using Short-Time Fourier Transform to unify different time resolutions. We extract a rich hierarchy of features by tapping into different network layers and flow times that apply varying strengths of noise to the input data. This enables the extraction of versatile representations, from low-level patterns to high-level global features, using a single model adaptable to specific tasks. Unlike prior generative SSL methods that use noisy inputs during inference, we propose using clean inputs for representation extraction while learning representations with noise; this eliminates randomness and boosts accuracy. We evaluate FGNO across three biomedical domains, where it consistently outperforms established baselines. Our method yields up to 35% AUROC gains in neural signal decoding (BrainTreeBank), 16% RMSE reductions in skin temperature prediction (DREAMT), and over 20% improvement in accuracy and macro-F1 on SleepEDF under low-data regimes. These results highlight FGNO's robustness to data scarcity and its superior capacity to learn expressive representations for diverse time series.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。