首个可部署在边缘设备的实时物理场感知神经算子,实现低功耗高效推理。
Real-Time Sensing of Inaccessible Physical Fields via an Edge-Deployable Hardware-Portable Graph Neural Operator

- 采用时空解耦架构,分担计算与内存瓶颈,适配边缘硬件执行
- 边缘端实现17.0样本/秒推理,功耗仅7.06瓦,能效比提升29倍
- 适用于高精度、低延迟的工程安全监测场景,如工业传感器网络
从稀疏边界观测中实时推断不可见内部物理场是科学机器学习中的基础难题,对众多工程安全监控应用至关重要。现有神经算子虽精度高,但未考虑嵌入式边缘平台部署。本文提出VIRSO(虚拟不规则实时稀疏算子),首个具备独特时空架构的神经算子,显式支持边缘硬件部署。VIRSO通过谱-空间分解,将稀疏几何离散边界输入映射到不规则非结构化网格上的连续多物理场,分别设计计算密集型图谱路径和内存带宽密集型空间聚合路径,并在数据中心与嵌入式加速器上独立表征。相比原始图算子基线,推理能耗-延迟积降低29倍(206 J·ms → 7.0 J·ms,NVIDIA H200),并在未修改条件下实现在NVIDIA Jetson Orin Nano上17.0样本/秒的推理,板级功耗仅7.06瓦。一种网格密度自适应图构建策略(V-KNN)同时提升精度并减少34%图边数。在三个基准测试中,重建比达47:1至156:1,平均相对L2误差低于1%,参数量更少,推理速度比高保真求解器快约10^4倍。据我们所知,这是首个单瓦特级神经算子,确立硬件协同设计为算子推理的关键缺失环节,为实时部署提供可行路径。
原文摘要 · Abstract (English)
Real-time inference of inaccessible interior physical fields from sparse boundary observations is a fundamental but unresolved problem in scientific machine learning, with direct relevance to safety-critical monitoring across many engineering applications. Existing neural operators achieve high accuracy but leave deployment to embedded edge platforms unaddressed. Here we introduce VIRSO (Virtual Irregular Real-Time Sparse Operator), the first neural operator with a unique spatial-spectral architecture that explicitly addresses edge-deployment hardware. VIRSO learns a nonlinear mapping from sparse, geometrically disjoint boundary inputs to spatially continuous interior multiphysics fields on irregular unstructured meshes through a spectral-spatial decomposition explicitly aligned with hardware execution: a compute-bound graph spectral pathway and a memory-bandwidth-bound spatial-aggregation pathway, each independently characterized on datacenter and embedded accelerators. The design reduces the inference energy-delay product by 29$\times$ relative to the vanilla graph-operator baseline (206 J$\cdot$ms $\to$ 7.0 J$\cdot$ms on an NVIDIA H200) and enables 17.0 samples/s embedded inference on an NVIDIA Jetson Orin Nano within 7.06 W board-level power, without modification. A mesh-density-adaptive graph construction strategy (V-KNN) simultaneously improves accuracy and reduces graph edge count by 34%. Across three benchmarks with reconstruction ratios from 47:1 to 156:1, VIRSO achieves mean relative $L_2$ errors below 1% with fewer parameters than operator baselines and delivers an inference speedup of $\approx 10^4$ times over the high-fidelity reference solver. To our knowledge, this is the first demonstration of a single-digit-watt neural operator, establishing hardware co-design as a missing ingredient in operator-based inference and a tractable path to real-time deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。