提出隐私保护的多模态脑电学习方法,提升帕金森病检测准确率。
Differentially Private Multimodal Laplacian Dropout (DP-MLD) for EEG Representative Learning
- 融合语言模型与视觉变换器,用跨模态注意力提取特征
- 设计自适应拉普拉斯丢弃机制,在隐私预算内优化性能
- 在帕金森冻结步态数据集上准确率提升4%,达当前最佳
近年来,多模态脑电图(EEG)学习在疾病检测中展现出巨大潜力。与此同时,由于法律和伦理考量,临床研究中的隐私保护日益重要。差分隐私(DP)因其解释清晰且易于实现,成为广泛采用的隐私保护方案。尽管已有众多基于DP的方法,但针对多模态EEG数据的研究仍不充分,原因在于模型与信号数据的复杂性。本文提出一种新型差分隐私多模态拉普拉斯丢弃(DP-MLD)方案,用于多模态EEG表示学习。该方法构建了一个新颖的多模态表示学习模型,将EEG数据以文本形式通过语言模型处理,其他模态数据以图像形式通过视觉变换器处理,并结合精心设计的跨注意力机制,有效提取和融合跨模态特征。为实现差分隐私,设计了一种新型自适应特征级拉普拉斯丢弃机制,在给定隐私预算下动态优化随机性分配与性能表现。在开放源码的帕金森病冻结步态(FoG)多模态数据集上的实验表明,所提方法分类准确率提升约4\/%,在差分隐私条件下达到多模态EEG学习的最先进水平。
原文摘要 · Abstract (English)
Recently, multimodal electroencephalogram (EEG) learning has shown great promise in disease detection. At the same time, ensuring privacy in clinical studies has become increasingly crucial due to legal and ethical concerns. One widely adopted scheme for privacy protection is differential privacy (DP) because of its clear interpretation and ease of implementation. Although numerous methods have been proposed under DP, it has not been extensively studied for multimodal EEG data due to the complexities of models and signal data considered there. In this paper, we propose a novel Differentially Private Multimodal Laplacian Dropout (DP-MLD) scheme for multimodal EEG learning. Our approach proposes a novel multimodal representative learning model that processes EEG data by language models as text and other modal data by vision transformers as images, incorporating well-designed cross-attention mechanisms to effectively extract and integrate cross-modal features. To achieve DP, we design a novel adaptive feature-level Laplacian dropout scheme, where randomness allocation and performance are dynamically optimized within given privacy budgets. In the experiment on an open-source multimodal dataset of Freezing of Gait (FoG) in Parkinson's Disease (PD), our proposed method demonstrates an approximate 4\% improvement in classification accuracy, and achieves state-of-the-art performance in multimodal EEG learning under DP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。