用去冗余信息最大化方法,为医学时序数据生成可解释的紧凑指纹表征。
Learning Fingerprints for Medical Time Series with Redundancy-Constrained Information Maximization

- 通过交叉注意力瓶颈生成固定数量的指纹令牌,压缩变长医学信号。
- 双目标训练使令牌既保留原始数据信息,又降低彼此冗余度。
- 适合需要可解释、低维医学特征的临床分析与数字生物标志物研究。
从心电图(ECG)或脑电图(EEG)等医学时序信号中学习有意义的表示是关键挑战。这些信号通常高维度、长度可变且噪声丰富。现有自监督方法如掩码自编码器(MAE)虽能有效预训练通用编码器,但未显式学习紧凑且语义可解释的潜在表示,通常依赖全局平均池化等启发式策略。本文提出新框架,将变长医学时序信号压缩为固定大小的 $k$ 个潜在指纹令牌。架构采用交叉注意力瓶颈生成令牌,并以双目标函数训练:第一目标为重建损失,确保令牌是原始数据的充分统计量;第二目标基于总编码速率(TCR)的多样性惩罚,显式最小化令牌间冗余,鼓励其成为统计解耦的表示。我们提供理论支持,将该方法视为新颖的 extbf{解耦率-失真} 问题。该方法生成低维、可解释且样本高效表示,每个令牌被激励捕捉独立变化因子,为更鲁棒的数字生物标志物奠定基础。
原文摘要 · Abstract (English)
Learning meaningful representations from medical time series (MedTS) such as ECG or EEG signals is a critical challenge. These signals are often high-dimensional, variable-length and rife with noise. Existing self-supervised approaches, such as Masked Autoencoders (MAEs) are highly effective for pre-training general-purpose encoders. However, they do not explicitly learn compact and semantically interpretable latent representations, typically relying on heuristic aggregation strategies such as global average pooling or a designated [CLS] token. We propose a novel framework that compresses a variable-length MedTS into a fixed-size set of $k$ latent Fingerprint Tokens. Our architecture employs a cross-attention bottleneck to generate these tokens and is trained with a dual-objective function. The first objective is a reconstruction loss, which ensures the tokens are \textit{sufficient statistics} for the original data. The second, a diversity penalty based on the Total Coding Rate (TCR), explicitly minimizes the redundancy between tokens, encouraging them to become statistically \textit{disentangled} representations. We present the theoretical justification for our method, framing it as a novel \textbf{Disentangled Rate-Distortion} problem. This approach produces a low-dimensional, interpretable, and sample-efficient representation, where each token is encouraged to capture an independent factor of variation, paving the way for more robust digital biomarkers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。