用WiFi数据生成毫米波和射频信号,解决稀缺数据难题
Cross-Modal Generation: From Commodity WiFi to High-Fidelity mmWave and RFID Sensing

- 分频段生成:高频引导+低频约束,跨模态合成更精准
- 生成的毫米波与射频信号在手势识别任务中表现优异
- 适合无线感知、数据稀缺场景下的模型训练与增强
AIGC在计算机视觉与自然语言处理领域取得显著成功,近期在无线领域也展现出巨大潜力。然而,射频模态间存在严重数据不平衡:WiFi数据丰富,而毫米波和射频(RF)数据因采集成本高而稀缺,导致难以训练高质量生成模型。本文提出RF-CMG,一种基于扩散模型的跨模态生成方法,利用数据丰富的WiFi信号合成高保真毫米波与射频数据。核心思路是将跨模态生成解耦为高频引导与低频约束:前者从有限目标模态数据中学习高频分布,后者通过低频约束保持物理结构一致性。在此基础上,引入模态引导嵌入(MGE)模块,引导反向扩散轨迹逼近目标高频分布;并设计低频模态一致性(LFMC)模块,在生成过程中逐步施加低频约束,抑制源模态结构偏差的累积,实现高质量目标模态生成。与多种主流生成模型对比显示,RF-CMG在合成射频与毫米波信号方面表现更优。进一步验证了生成数据在手势识别任务中的有效性,并分析了合成数据比例对下游性能的影响。
原文摘要 · Abstract (English)
AIGC has shown remarkable success in CV and NLP, and has recently demonstrated promising potential in the wireless domain. However, significant data imbalance exists across RF modalities, with abundant WiFi data but scarce mmWave and RFID data due to high acquisition cost. This makes it difficult to train high-quality generative models for these data-scarce modalities. In this work, we propose RF-CMG, a diffusion-based cross-modal generative method that leverages data-rich WiFi signals to synthesize high-fidelity RF data for scarce modalities including mmWave and RFID. The key insight of RF-CMG is to decouple cross-modal generation into high-frequency guidance and low-frequency constraint, which respectively learn high-frequency distribution from limited target modality data and preserve the underlying physical structure via low-frequency constraints during generation. On this basis, we introduce a Modality-Guided Embedding (MGE) module to steer the reverse diffusion trajectory toward the target high-frequency distribution, and a Low-Frequency Modality Consistency (LFMC) module to progressively enforce low-frequency constraints to suppress the accumulation of source-modality structural biases during inference, enabling high-quality target-modality generation. Performance comparison with several prevalent generative models demonstrates that RF-CMG achieves superior performance in synthesizing RFID and mmWave signals. We further showcase the effectiveness of the data generated by RF-CMG in gesture recognition tasks, and analyze the impact of the proportion of synthetic data on downstream performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。