针对稀疏传感器网络,提出局部感知的Transformer模型,提升时空数据重建精度。
FieldFormer: Locality-Aware Transformers for Spatio-Temporal Modeling on Sparse Sensor Networks
- 通过可学习的速度缩放偏移,动态捕捉局部时空依赖关系。
- 在极端稀疏条件下,相比基线模型,预测误差降低23%~41%。
- 适合传感器分布不均、局部依赖明显的环境监测场景。
真实系统中的时空传感器数据通常稀疏、嘈杂且不规则,导致潜在场重建本质上约束不足。在极端稀疏情况下,多个物理上合理的场可能与相同观测一致,需依赖关于局部性、传输和空间规律的归纳偏置。在此类情形下,可靠重建集中于传感器网络诱导的观测支持域,使传感器空间建模比全局场恢复更具可识别性。本文提出FieldFormer,一种用于持久传感器网络的无网格变换器架构,实现局部感知的传感器空间建模。对于每个查询,FieldFormer使用可学习的速度缩放偏移聚合局部证据,自适应调整邻域几何以匹配时空依赖。邻域基于附近传感器的固定最大稀疏上下文及有限时间窗口构建,确保在极端稀疏条件下的稳定与可扩展推理。局部变换器编码器整合邻域信息,坐标式神经场形式支持无网格预测。我们在五个合成与真实世界基准上评估FieldFormer,涵盖各向异性热扩散、浅水动力学、大气传输及污染监测数据集。结果表明,当局部依赖域仍被观测时,局部感知重建具有显著优势,使FieldFormer在稀疏传感器空间预测任务中持续优于最先进基线。
原文摘要 · Abstract (English)
Spatio-temporal sensor data in real-world systems is often sparse, noisy, and irregular, making latent field reconstruction fundamentally underconstrained. Under extreme sparsity, multiple physically plausible fields may remain consistent with the same observations, requiring models to rely on inductive biases about locality, transport, and spatial regularity. In such regimes, reliable reconstruction is concentrated around the observational support induced by the sensor network, making sensor-space modeling a more identifiable objective than unconstrained global field recovery. We introduce FieldFormer, a mesh-free transformer architecture for locality-aware sensor-space modeling in persistent sensor networks. For each query, FieldFormer aggregates local evidence using learnable velocity-scaled offsets that adapt neighborhood geometry to spatio-temporal dependencies. Neighborhoods are constructed as fixed maximal sparse contexts over nearby sensors and bounded temporal windows, enabling stable and scalable inference under extreme sparsity. A local transformer encoder integrates neighborhood information, while a coordinate-based neural field formulation supports mesh-free prediction. We evaluate FieldFormer on five synthetic and real-world benchmarks, including anisotropic heat diffusion, shallow-water dynamics, atmospheric transport, and pollution monitoring datasets. Results show that locality-aware reconstruction provides strong advantages when local domains of dependence remain observed, enabling FieldFormer to consistently outperform state-of-the-art baselines on sparse sensor-space prediction tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。