arXiv:2606.06328cs.LGcs.AI2026-06

针对医疗多模态时间序列缺失数据,提出显式建模两种缺失模式的新方法。

PAMF: Prior-Aware Multimodal Fusion for Incomplete Time Series Data

论文配图:PAMF: Prior-Aware Multimodal Fusion for Incomplete Time Series Data
图 1 · 摘自论文原文
  • 基于先验信息区分模态内缺失与模态级缺失,显式建模不同缺失类型。
  • 通过共享权重的编码器将下游任务与数据补全过程耦合,提升补全质量。
  • 在多个医疗时间序列数据集上表现优于现有方法,尤其在复杂缺失场景下。

在医疗领域,多模态时间序列任务常面临不完整观测问题,例如心电图片段因电极脱落丢失,或整段呼吸信号在夜间监测中不可用。缺失通常呈现两种结构性模式:模态内缺失(同一模态中部分值缺失)和模态级缺失(整个模态不可用)。现有方法通常通过掩码或缺失嵌入隐式表示未观测数据,缺乏对具体缺失实例的学习,且多数仅适用于单一缺失模式。直接估计缺失数据虽为自然思路,但现有插补方法忽视不同缺失模式的结构先验,且插补过程与下游任务脱节,无法利用任务反馈优化表示。为此,本文提出PAMF框架,显式处理两类缺失模式,并通过先验感知的流匹配与权重共享,将插补与下游预测耦合。具体地,以类型特异性先验初始化流匹配源状态,区分缺失类型;并通过架构匹配的编码器共享权重,将任务相关表征引入插补过程。在多个多模态医疗时间序列基准测试上,所提方法在多样数据集和缺失设置下均取得最优整体下游性能,显著优于现有基线。

原文摘要 · Abstract (English)

In healthcare, multimodal time series tasks often operate on incomplete observations in practice, for example when ECG segments are lost because electrodes detach or an entire respiratory channel is unavailable during overnight monitoring. Such missingness typically appears in two structurally distinct patterns: within-modality missing, where values are absent within an otherwise observed modality, and modality-level missing, where an entire modality is unavailable. Existing methods typically represent unobserved data implicitly through masks or missing embeddings, without learning instance-specific missing information, and most are designed for only one missingness pattern. A natural approach is to explicitly estimate the missing data; however, existing imputation methods treat missingness uniformly despite their different structural priors, and the imputation process is often isolated from downstream tasks, preventing downstream tasks from guiding imputation toward more informative representations. To address these limitations, we present PAMF, a multimodal time-series framework that explicitly handles different missingness patterns while coupling imputation with downstream prediction through prior-aware flow matching and weight sharing. Specifically, the method initializes the flow-matching source state with type-specific priors to distinguish two missing types. It further connects imputation and classification through architecturally matched encoders with weight sharing, transferring task-relevant representations into the imputation process. Experiments on multiple multimodal healthcare time-series benchmarks show that the proposed method achieves the strongest overall downstream performance across diverse datasets and missing settings compared with existing baselines.

多模态时间序列缺失数据医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。