arXiv:2609.04504cs.AIcs.IR2026-09

用Transformer融合多种生理数据,生成更精准的健康状态指标。

BioSync: Transformer-Based Cross-Modal Fusion for a Multimodal Physiological Digital Biomarker

  • 采用多头自注意力与线性分支联合建模跨模态信息
  • 在认知衰退和代谢自主神经两组数据中表现优于传统拼接方法
  • 适合可穿戴设备健康监测、临床数字生物标志物研究者

可穿戴和移动设备获取的心脏、神经、行为及语音数据提供了生理状态的部分且易受噪声干扰的观测。BioSync将这些数据整合为基于BEST框架定义的连续复合数字生物标志物——生物同步指数(BSI)。模型使用多头自注意力处理模态标记,并引入一个包含标准特征拼接的线性分支。该架构基于潜在变量测量理论,假设联合观测包含单模态无法获取的信息。我们在两个文献启发的合成队列上评估:四模态认知衰退队列(含HRV、EEG、活动记录仪、语音)和基于公开AI-READI可穿戴方案的代谢-自主神经队列。在认知队列中,BioSync与拼接方法的AUC分别为0.928和0.926;在代谢队列中,准确率/精确率为0.764/0.766,优于拼接的0.756/0.758。BSI在两队列中与潜在严重程度相关(r=0.91、r=0.68)。纯注意力消融实验的AUC为0.911,表明宽深结构贡献了性能提升。在匹配模态丢弃训练下,BioSync在五个六种认知队列扰动率中优于拼接,且在最高代谢队列扰动率下领先。其认知队列AUC高于五项已有数字生物标志物参考值,但因数据集与任务差异,无法进行受控基准对比。在六项预设标准下对比单模态、早融合与晚融合设计,揭示了模型计算特性;真实队列验证仍需开展。

原文摘要 · Abstract (English)

Cardiac, neural, behavioral, and speech measurements from wearable and mobile devices provide partial, noise-sensitive views of physiological state. BioSync combines these measurements into the \textbf{BioSync Index (BSI)}, a continuous composite digital biomarker defined under the BEST framework. The model applies multi-head self-attention to modality tokens and adds a linear branch whose hypothesis class includes standard feature concatenation. This architecture is motivated by latent-variable measurement theory and by the possibility that joint observations contain information unavailable from individual modalities. We evaluated BioSync on two literature-informed synthetic cohorts: a four-modality cognitive-decline cohort using HRV, EEG, actigraphy, and speech, and a metabolic-autonomic cohort structured around the public AI-READI wearable schema. In the cognitive cohort, BioSync and concatenation obtained AUCs of 0.928 and 0.926, respectively. In the metabolic cohort, BioSync obtained accuracy/F1 of 0.764/0.766, compared with 0.756/0.758 for concatenation. The BSI correlated with latent severity in both cohorts ($r=0.91$ and $r=0.68$). A pure-attention ablation obtained cognitive-cohort AUC 0.911, locating the increase to 0.928 in the combined wide-and-deep architecture. With matched modality-dropout training, BioSync led concatenation at five of six cognitive-cohort corruption rates and at the highest metabolic-cohort rate. Its cognitive-cohort AUC was also higher than five published digital-biomarker reference values, although differences in datasets and tasks preclude a controlled benchmark claim. Comparison with single-modality, early-fusion, and late-fusion designs across six prespecified criteria identifies the model's computational properties; validation on real cohorts remains necessary.

数字生物标志物多模态融合Transformer可穿戴健康

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。