用专家模型提升医疗时间序列补全效果,一次推理完成多路生成融合。
Advancing time series completion via RFAMoE and MDFF
- 基于扩散模型设计可自适应选择感受野的专家模块(RFAMoE)
- 单次推理完成多路噪声信号生成与融合,准确率超越现有方法
- 特别适合对实时性要求高、数据噪声大的医疗时序补全任务
近期研究显示,扩散模型在时间序列信号重建方面具有巨大潜力,但在医疗时间序列领域仍鲜有探索。生理信号具有多变量、高时间波动性、强噪声和易受伪影影响等特性,使深度学习方法在插补任务中仍面临挑战。为此,我们提出一种基于混合专家(MoE)的噪声估计器,嵌入评分函数扩散框架。具体地,设计了感受野自适应混合专家(RFAMoE)模块,使各通道可在扩散过程中自适应选择最优感受野。此外,已有研究表明多次推理并平均结果能有效降低重建误差,但带来显著计算与延迟开销。我们设计了融合专家模块,创新性利用MoE结构并行生成K个噪声信号,通过路由机制融合,在单次推理中完成信号重建。该设计不仅提升性能,更消除了多轮推理带来的高昂计算成本与延迟。大量实验表明,所提框架在不同任务与数据集上均持续优于现有扩散模型最先进方法。
原文摘要 · Abstract (English)
Recent studies show that using diffusion models for time series signal reconstruction holds great promise. However, such approaches remain largely unexplored in the domain of medical time series. The unique characteristics of the physiological time series signals, such as multivariate, high temporal variability, highly noisy, and artifact-prone, make deep learning-based approaches still challenging for tasks such as imputation. Hence, we propose a novel Mixture of Experts (MoE)-based noise estimator within a score-based diffusion framework. Specifically, the Receptive Field Adaptive MoE (RFAMoE) module is designed to enable each channel to adaptively select desired receptive fields throughout the diffusion process. Moreover, recent literature has found that when generating a physiological signal, performing multiple inferences and averaging the reconstructed signals can effectively reduce reconstruction errors, but at the cost of significant computational and latency overhead. We design a Fusion MoE module and innovatively leverage the nature of MoE module to generate K noise signals in parallel, fuse them using a routing mechanism, and complete signal reconstruction in a single inference step. This design not only improves performance over previous methods but also eliminates the substantial computational cost and latency associated with multiple inference processes. Extensive results demonstrate that our proposed framework consistently outperforms diffusion-based SOTA works on different tasks and datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。