用可自适应的专家模型融合多模态数据,提升低空网络感知与通信性能。
Multimodal Mixture-of-Experts for ISAC in Low-Altitude Wireless Networks
- 每个传感模态由专用专家处理,通过轻量门控动态分配权重。
- 在三种典型任务中,模型性能优于传统融合方法,且更省样本。
- 稀疏专家结构降低计算开销,适合能量受限的飞行设备使用。
集成感知与通信(ISAC)是低空无线网络(LAWNs)的关键技术,在复杂空域场景中实现环境感知与数据传输同步。通过融合视觉、雷达、激光雷达及位置等异构感知模态,多模态ISAC可提升态势感知能力与系统鲁棒性。然而,现有融合方法多采用静态策略,对所有模态同等对待,无法适应信道异质性或动态环境中模态可靠性的变化。为此,本文提出一种面向LAWNs的多模态混合专家(MoE)框架。各模态由专属专家网络处理,轻量级门控模块根据模态实时信息量与可靠性自适应分配融合权重。为应对飞行平台严苛的能效约束,进一步设计稀疏MoE变体,仅激活部分专家,显著降低计算开销,同时保留自适应融合优势。在三类典型ISAC任务上的全面仿真表明,所提框架在学习性能与训练样本效率上均持续优于传统多模态融合基线。
原文摘要 · Abstract (English)
Integrated sensing and communication (ISAC) is a key enabler for low-altitude wireless networks (LAWNs), providing simultaneous environmental perception and data transmission in complex aerial scenarios. By combining heterogeneous sensing modalities such as visual, radar, lidar, and positional information, multimodal ISAC can improve both situational awareness and robustness of LAWNs. However, most existing multimodal fusion approaches use static fusion strategies that treat all modalities equally and cannot adapt to channel heterogeneity or time-varying modality reliability in dynamic low-altitude environments. To address this fundamental limitation, we propose a mixture-of-experts (MoE) framework for multimodal ISAC in LAWNs. Each modality is processed by a dedicated expert network, and a lightweight gating module adaptively assigns fusion weights according to the instantaneous informativeness and reliability of each modality. To improve scalability under the stringent energy constraints of aerial platforms, we further develop a sparse MoE variant that selectively activates only a subset of experts, thereby reducing computation overhead while preserving the benefits of adaptive fusion. Comprehensive simulations on three typical ISAC tasks in LAWNs demonstrate that the proposed frameworks consistently outperform conventional multimodal fusion baselines in terms of learning performance and training sample efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。