arXiv:2608.12592cs.LG2026-08

用多模态信号生成缺失的生理数据,更准且适应不规则缺失。

Represent, Then Generate: Multimodal-Conditioned Time-Series Generation under Irregular Missingness

论文配图:Represent, Then Generate: Multimodal-Conditioned Time-Series Generation under Irregular Missingness
图 1 · 摘自论文原文
  • 先分别编码各模态信号,再融合生成目标信号
  • 在三个数据库上16项任务均超越现有方法,13项接近真实数据表现
  • 适合临床中需替代侵入式监测的场景

连续生理时间序列支撑现代临床监测,但许多高价值信号因侵入性、成本或不可得而缺失。条件生成可解决此问题:从共记录信号与常规变量合成缺失信号。现有方法仅依赖单一条件模态,在混合异质、不规则缺失的时间序列与静态协变量下性能下降。我们提出ReCoGen(Represent Conditions, then Generate),两阶段框架将多模态条件表示与目标生成解耦。第一阶段为每种模态训练一个掩码自编码器,将时间序列条件压缩为紧凑且耐缺失的标记序列。第二阶段训练一个流匹配生成器,融合这些标记与静态条件以合成目标信号。在三个生理基准测试中,包括在AI-READI上的连续血糖监测和在MIMIC-III、MIMIC-IV上的动脉血压生成,ReCoGen在全部十六个(数据集、任务、指标)组合上取得最佳下游效用,超越六种代表性条件生成器;其中十三项任务的效用达到或超过真实信号水平,我们将其视为近似参考而非上限。消融实验表明性能提升源于条件路径设计:对冻结的单模态编码器进行可学习交叉注意力,以及静态条件的双标记加AdaLN路径。ReCoGen因此将常规采集信号转化为侵入性或不可得信号的有效替代,推动更少侵入、低成本的持续临床监测。

原文摘要 · Abstract (English)

Continuous physiological time series underpin modern clinical monitoring, yet many of the most informative signals are invasive, expensive, or simply unavailable for a given patient. Conditional generation offers a remedy: an absent signal can be synthesized from co-recorded signals and routine clinical variables. Existing generators, however, are built around a single conditioning modality and degrade when forced to handle the heterogeneous, irregularly missing mix of time-variant signals and static covariates seen in practice. We propose ReCoGen (Represent Conditions, then Generate), a two-stage framework that decouples multimodal condition representation from target generation. Stage I trains one masked autoencoder per modality, distilling each time-variant condition into a compact and missingness-tolerant token sequence. Stage II trains a flow-matching generator that fuses these tokens with static conditions to synthesize the target signal. Across three physiological benchmarks, including continuous glucose monitoring on AI-READI and arterial blood pressure generation on MIMIC-III and MIMIC-IV, ReCoGen attains the best downstream utility on all sixteen (dataset, task, metric) settings, surpassing six representative conditional generators; on thirteen of them its utility also reaches or exceeds the utility measured on the real signal, a reference we read as an approximate anchor rather than a ceiling. Ablations trace the gains to the conditioning path: learnable cross-attention over the frozen per-modality encoders, and a dual token-plus-AdaLN route for the static conditions. ReCoGen thus turns routinely collected signals into informative surrogates for invasive or unavailable ones, a step toward less invasive, lower-cost continuous clinical monitoring.

时序生成多模态医疗数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。