用电磁场数据重建高分辨率材料参数,打造可模拟的数字孪生体。
Neural Electromagnetic Fields for High-Resolution Material Parameter Reconstruction
- 基于图像几何和射频信号,解耦环境场与材料属性
- 在合成数据上实现毫米级材料参数重建精度
- 适合物理仿真、数字孪生与无损检测研究者
构建功能完整的数字孪生——可模拟的现实世界三维复制品——是计算机视觉的核心挑战。当前方法如NeRF生成视觉丰富的模型,但缺乏功能性的材料属性(如介电常数、电导率)。通过非接触、无创传感获取场景中每一点的材料信息是主要目标,但这需解决一个著名的不适定物理反演问题。标准远程信号(如图像和射频)深度耦合未知几何、环境场与目标材料。本文提出NEMF框架,用于密集、无创的物理反演,以构建功能性数字孪生。核心思路是系统性解耦:利用图像获得的高保真几何作为锚点,首先恢复环境场。仅使用非侵入式数据约束几何与场后,原不适定问题转化为有良好定义的物理监督学习任务。这一转化使我们的核心反演模块——解码器——得以工作:它在射频信号引导下,结合可微分的物理反射模型,学习输出连续、空间变化的材料参数场。我们在高保真合成数据集上验证了该框架。实验表明,非侵入式反演能高精度重建材料图,并生成支持高保真物理仿真的功能数字孪生。此进展超越被动视觉复制品,推动真实世界可模拟模型的创建。
原文摘要 · Abstract (English)
Creating functional Digital Twins, simulatable 3D replicas of the real world, is a central challenge in computer vision. Current methods like NeRF produce visually rich but functionally incomplete twins. The key barrier is the lack of underlying material properties (e.g., permittivity, conductivity). Acquiring this information for every point in a scene via non-contact, non-invasive sensing is a primary goal, but it demands solving a notoriously ill-posed physical inversion problem. Standard remote signals, like images and radio frequencies (RF), deeply entangle the unknown geometry, ambient field, and target materials. We introduce NEMF, a novel framework for dense, non-invasive physical inversion designed to build functional digital twins. Our key insight is a systematic disentanglement strategy. NEMF leverages high-fidelity geometry from images as a powerful anchor, which first enables the resolution of the ambient field. By constraining both geometry and field using only non-invasive data, the original ill-posed problem transforms into a well-posed, physics-supervised learning task. This transformation unlocks our core inversion module: a decoder. Guided by ambient RF signals and a differentiable layer incorporating physical reflection models, it learns to explicitly output a continuous, spatially-varying field of the scene's underlying material parameters. We validate our framework on high-fidelity synthetic datasets. Experiments show our non-invasive inversion reconstructs these material maps with high accuracy, and the resulting functional twin enables high-fidelity physical simulation. This advance moves beyond passive visual replicas, enabling the creation of truly functional and simulatable models of the physical world.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。