arXiv:2607.17244cs.LG2026-07

动态建模免疫谱系演化,提升患者免疫状态预测精度。

DynImmune-BERT: Dynamic Immune Repertoire Modeling with Neural ODE Driven Continuous Transformers

论文配图:DynImmune-BERT: Dynamic Immune Repertoire Modeling with Neural ODE Driven Continuous Transformers
图 1 · 摘自论文原文
  • 用神经微分方程捕捉克隆动态变化,支持连续时间建模。
  • 在小样本外部队列中仍保持高预测准确性,尤其对罕见克隆敏感。
  • 适合研究免疫应答、疫苗反应或自身免疫病的纵向数据挖掘。

纵向T细胞受体谱系包含克隆扩增、收缩、消失和重现等免疫扰动信号。传统静态谱系语言模型通常将样本视为序列集合,难以体现采样间隔、测序深度及克隆存在模式。本文提出DynImmune-BERT,一种用于患者级免疫状态预测的连续时间谱系模型。该方法结合深度自适应中心对数比初始化、克隆存在门控神经常微分方程动力学、有界邻域自注意力、基于事件的状态重置,以及混合传输目标(监督主导与稀有克隆质量)。低秩元适配器初始化重现克隆型,参数量与观测克隆数无关。评估分离了文献基准与内部时序对比,报告小外部队列不确定性,加入校准与阈值诊断,并可视化潜在克隆轨迹与注意力邻域。结果表明,事件感知的时间建模可补充强静态编码器,当具备纵向谱系结构时表现更优;但小样本队列与协议差异需谨慎解读。

原文摘要 · Abstract (English)

Longitudinal T cell receptor repertoires contain signals of clonal expansion, contraction, disappearance, and reappearance after immune perturbation. Static repertoire language models usually summarize a sample as a bag of sequences, so the sampling interval, sequencing depth, and clone presence pattern are only weakly represented. This paper presents DynImmune-BERT, a continuous time repertoire model for patient level immune status prediction. The method combines depth adaptive centered log ratio initialization, clone presence gated Neural ordinary differential equation dynamics, bounded neighborhood self attention, event based state restart, and a hybrid transport objective that supervises dominant and rare clone mass. A low rank meta adapter initializes reappearing clonotypes while keeping the parameter count independent of the number of observed clones. The evaluation separates literature reported baselines from internally controlled temporal comparisons, reports uncertainty for small external cohorts, adds calibration and threshold diagnostics, and visualizes latent clone trajectories and attention neighborhoods. The results indicate that event aware temporal modeling can complement strong static encoders when longitudinal repertoire structure is available, while small external cohorts and protocol differences require cautious interpretation.

免疫谱系动态建模神经ODE时序分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。