arXiv:2605.08288cs.LGcs.AI2026-05

解决跨模态设备定位中隐私保护与数据异构难题。

UMEDA: Unified Multi-modal Efficient Data Fusion for Privacy-Preserving Graph Federated Learning via Spectral-Gated Attention and Diffusion-Based Operator Alignment

论文配图:UMEDA: Unified Multi-modal Efficient Data Fusion for Privacy-Preserving Graph Federated Learning via Spectral-Gated Attention and Diffusion-Based Operator Alignment
图 1 · 摘自论文原文
  • 用谱门控注意力对齐不同传感器数据到统一低秩空间。
  • 通过扩散模型聚合更新,适应不同图规模和缺失模态。
  • 结合差分隐私保护关键信号,适合高异构隐私场景。

无设备定位需从分布于边缘设备的异构无线与视觉传感器(如Wi-Fi、LiDAR)中训练模型。联邦学习虽具隐私保护优势,但在客户端传感器模态与分辨率差异大、数据分布漂移、隐私噪声破坏结构信号时表现脆弱。本文提出UMEDA,一种图联邦学习框架:客户端作为全局图节点,共享连续积分算子,聚合重定义为该算子上的谱信号处理。每个客户端用线性注意力层编码本地传感器,其核谱经低秩滤波,抑制模态特异性残差,使不同传感器客户端对齐至共同低秩子空间。服务器则通过算子核谱系数的扩散模型聚合客户端更新,将更新视为共享算子的离散化而非依赖拓扑的权重——此机制可容纳不同图大小与缺失模态,无需节点对应。为平衡隐私与效用,引入各向异性差分隐私机制,优先将噪声投影至信号子空间的零空间,保留主导特征方向,且在梯度截断下满足正式$(ε, δ)$-DP。在MM-Fi与RELI11D外分布基准上,UMEDA优于现有先进联邦基线,在准确率、收敛速度与通信效率方面表现突出,尤其在高模态异构与严苛隐私预算下优势显著。

原文摘要 · Abstract (English)

Device-free localization trains models from heterogeneous wireless and visual sensors (e.g., Wi-Fi, LiDAR) distributed across edge devices. Federated learning offers a privacy-respecting framework, but is brittle when clients differ in sensor modality and resolution, when their data distributions drift, and when privacy noise destroys the structural signal needed for localization. We propose UMEDA, a graph federated learning framework in which clients form nodes of a global graph that share a continuous integral operator, and aggregation is reformulated as spectral signal processing on this operator. Each client encodes its local sensors with a linear-attention layer whose kernel spectrum is low-rank filtered, suppressing modality-specific residuals so clients with different sensors align in a common low-rank subspace. The server then aggregates client updates via a diffusion model over the kernel's spectral coefficients, treating updates as discretizations of a shared operator rather than topology-bound weights -- this absorbs varying graph sizes and missing modalities without node-wise correspondence. To balance privacy and utility, we add an anisotropic differential-privacy mechanism that projects noise preferentially into the null space of the signal subspace, preserving dominant eigendirections while ensuring formal $(ε, δ)$-DP under gradient clipping. On MM-Fi and the RELI11D out-of-distribution benchmark, UMEDA outperforms state-of-the-art federated baselines in accuracy, convergence, and communication efficiency, particularly under high modality heterogeneity and tight privacy budgets.

联邦学习多模态融合隐私保护图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。