EMind首次构建电磁信号统一基础模型,实现多任务智能理解。
EMind: A Foundation Model for Multi-task Electromagnetic Signals Understanding
- 设计自适应信号打包与硬件感知训练策略,提升异构信号表征效率。
- 在多类电磁任务中表现优异,显著超越专用模型的泛化能力。
- 适合雷达、通信、感知等跨领域研究者,推动电磁智能通用化。
电磁信号深度理解对动态频谱管理、智能交通、自动驾驶和无人系统感知至关重要。由于电磁信号与文本、图像差异大,具有高度异质性、强背景噪声及复杂的时频结构,现有通用模型难以直接应用。电磁通信与感知任务多样,当前方法缺乏跨任务泛化与迁移效率,且高质量大规模数据集稀缺,阻碍了真正通用的多任务学习框架发展。为此,我们提出EMind——首个面向电磁信号的基础模型,融合大规模预训练与该模态独特性。构建了首个覆盖多种信号类型与任务的统一标准化电磁信号数据集。通过利用电磁信号的物理特性,设计长度自适应多信号打包方法与硬件感知训练策略,实现异源多信号高效利用与表示学习。实验表明,EMind在多个下游任务中表现强劲,具备广泛泛化能力,推动电磁智能从专用模型迈向统一框架。代码已开源:https://github.com/GabrielleTse/EMind。
原文摘要 · Abstract (English)
Deep understanding of electromagnetic signals is fundamental to dynamic spectrum management, intelligent transportation, autonomous driving and unmanned vehicle perception. The field faces challenges because electromagnetic signals differ greatly from text and images, showing high heterogeneity, strong background noise and complex joint time frequency structure, which prevents existing general models from direct use. Electromagnetic communication and sensing tasks are diverse, current methods lack cross task generalization and transfer efficiency, and the scarcity of large high quality datasets blocks the creation of a truly general multitask learning framework. To overcome these issue, we introduce EMind, an electromagnetic signals foundation model that bridges large scale pretraining and the unique nature of this modality. We build the first unified and largest standardized electromagnetic signal dataset covering multiple signal types and tasks. By exploiting the physical properties of electromagnetic signals, we devise a length adaptive multi-signal packing method and a hardware-aware training strategy that enable efficient use and representation learning from heterogeneous multi-source signals. Experiments show that EMind achieves strong performance and broad generalization across many downstream tasks, moving decisively from task specific models to a unified framework for electromagnetic intelligence. The code is available at: https://github.com/GabrielleTse/EMind.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。