arXiv:2512.11894cs.CVcs.LG2025-12中稿 · the IEEE/CVF Winte…被引 1

用照片和文字生成真实毫米波信号,提升识别精度与速度

mmWEAVER: Environment-Specific mmWave Signal Synthesis from a Photo and Activity Description

  • 将毫米波信号建模为连续函数,通过隐式神经表示实现高效合成
  • 生成信号在复杂度上压缩49倍,活动识别准确率提升7%,姿态误差降低15%
  • 适合需要真实信号数据的雷达感知、动作识别研究者使用

真实信号生成与数据增强对推进毫米波雷达应用(如动作识别与姿态估计)至关重要,但毫米波信号本身复杂、稀疏且高维,物理仿真计算成本高昂。本文提出mmWeaver框架,通过隐式神经表示(INRs)将毫米波信号建模为连续函数,实现最高49倍的数据压缩。该方法结合超网络,根据RGB-D图像提取的环境上下文与MotionGPT生成的人体运动特征动态生成INR参数,实现高效自适应信号合成。在多分辨率下生成保留相位信息的复数信号,支持点云估计与动作分类等下游任务。实验表明,mmWeaver在信号真实性上达到复杂结构相似性(SSIM)0.88、峰值信噪比(PSNR)35 dB,优于现有方法,同时使活动识别准确率提升7%,人体姿态估计误差降低15%,且运行速度比基于仿真的方法快6-35倍。

原文摘要 · Abstract (English)

Realistic signal generation and dataset augmentation are essential for advancing mmWave radar applications such as activity recognition and pose estimation, which rely heavily on diverse, and environment-specific signal datasets. However, mmWave signals are inherently complex, sparse, and high-dimensional, making physical simulation computationally expensive. This paper presents mmWeaver, a novel framework that synthesizes realistic, environment-specific complex mmWave signals by modeling them as continuous functions using Implicit Neural Representations (INRs), achieving up to 49-fold compression. mmWeaver incorporates hypernetworks that dynamically generate INR parameters based on environmental context (extracted from RGB-D images) and human motion features (derived from text-to-pose generation via MotionGPT), enabling efficient and adaptive signal synthesis. By conditioning on these semantic and geometric priors, mmWeaver generates diverse I/Q signals at multiple resolutions, preserving phase information critical for downstream tasks such as point cloud estimation and activity classification. Extensive experiments show that mmWeaver achieves a complex SSIM of 0.88 and a PSNR of 35 dB, outperforming existing methods in signal realism while improving activity recognition accuracy by up to 7% and reducing human pose estimation error by up to 15%, all while operating 6-35 times faster than simulation-based approaches.

毫米波雷达信号合成动作识别隐式表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。