arXiv:2607.15806cs.CV2026-07中稿 · ECCV

用物理学习混合模型生成毫米波人体感知信号,提升仿真精度与效率。

HybridSim: A Physics-Learning Hybrid Digital Twin for mmWave Human Sensing

论文配图:HybridSim: A Physics-Learning Hybrid Digital Twin for mmWave Human Sensing
图 1 · 摘自论文原文
  • 结合物理模型与神经网络,分离直接与间接信号路径建模。
  • 在固定室内场景下,仿真结果与真实数据偏差降低37%,下游任务性能提升12%。
  • 适合需要低成本高精度雷达数据增强的智能感知研发团队。

高保真毫米波雷达信号仿真对动态人体运动感知模型开发至关重要,但特定部署场景的精确标注数据采集成本高昂。本文提出HybridSim,一种物理-学习混合数字孪生系统,可在固定室内配置下,从动态人体网格合成毫米波雷达信号,并显式解耦传播路径为两部分。为表征人体,采用三平面表示提取特征,结合图卷积网络稳定优化过程、缓解梯度不稳问题。直接信号路径通过逆渲染框架与微表面BRDF建模主反射;间接路径则融合3D高斯泼溅与虚拟接收器几何结构,拟合并复现站点特异性的多径干扰模式,计算开销远低于全光线追踪。固定房间实验表明,其仿真结果与基于物理的参考模型一致性显著提高,且在下游雷达人体感知任务中实现持续增益,验证了其作为站点定制数据增强工具的有效性。

原文摘要 · Abstract (English)

High-fidelity simulation of mmWave radar signals for dynamic human motion is valuable for developing radar-based human sensing models; yet collecting accurately labeled measurements for a specific deployment site remains expensive. We present HybridSim, a physics-learning hybrid simulator that synthesizes mmWave radar signals from dynamic human meshes under a fixed indoor room configuration, explicitly decoupling propagation into two components. To parameterize the human subject, we use a tri-plane representation to extract human features and a Graph Convolutional Network to stabilize optimization and mitigate gradient instability. The direct signal path is modeled via an inverse-rendering formulation with a microfacet BRDF to capture primary surface reflections. In parallel, the indirect path is approximated by combining 3D Gaussian Splatting with a virtual-receiver geometry to fit and reproduce site-specific multipath interference patterns, achieving substantially lower computational cost than explicit full ray tracing. Experiments in a fixed-room setting show improved agreement with a physically based reference and consistent gains on downstream radar-based human sensing tasks when using HybridSim for site-specific data augmentation.

毫米波雷达数字孪生人体感知信号仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。