arXiv:2409.00230cs.LGcs.AI2024-09被引 29

用跨注意力扩散模型,从稀疏观测中重建复杂空间场。

Spatially-Aware Diffusion Models with Cross-Attention for Global Field Reconstruction with Sparse Observations

  • 通过可学习条件编码融合观测与插值,构建观测到未观测区域的映射。
  • 在含噪条件下优于传统方法,且能捕捉多种可能重建结果。
  • 适合动态传感器、不完整数据下的空间场重构任务。

扩散模型因其对复杂分布的建模能力和不确定性表达,在噪声或不完整数据下具备鲁棒预测潜力。本文针对从部分观测中重建完整空间场的任务,改进基于得分的扩散模型。提出一种条件编码方法,利用可学习的稀疏观测与插值场的融合作为归纳偏置,建立可观测与不可观测区域间的可处理映射。结合优化的感知表示与解耦的时间维度,该方法可应对任意移动传感器并有效重建空间场。我们在多种静态与时变偏微分方程(PDE)上,将本方法与确定性插值法进行综合对比。研究填补了在采样超参数、噪声水平及条件方法变化下缺乏强基线的问题。结果表明,在含噪条件下,带交叉注意力与所提条件编码的扩散模型通常优于其他方法;而确定性方法在无噪数据下表现更优。此外,两者在稳态问题上均显著超越数值方法,在精度与计算成本上更具优势。我们还通过集合采样验证了模型在协方差修正任务中捕捉多种可能重构并提升融合结果准确性的能力。

原文摘要 · Abstract (English)

Diffusion models have gained attention for their ability to represent complex distributions and incorporate uncertainty, making them ideal for robust predictions in the presence of noisy or incomplete data. In this study, we develop and enhance score-based diffusion models in field reconstruction tasks, where the goal is to estimate complete spatial fields from partial observations. We introduce a condition encoding approach to construct a tractable mapping mapping between observed and unobserved regions using a learnable integration of sparse observations and interpolated fields as an inductive bias. With refined sensing representations and an unraveled temporal dimension, our method can handle arbitrary moving sensors and effectively reconstruct fields. Furthermore, we conduct a comprehensive benchmark of our approach against a deterministic interpolation-based method across various static and time-dependent PDEs. Our study attempts to addresses the gap in strong baselines for evaluating performance across varying sampling hyperparameters, noise levels, and conditioning methods. Our results show that diffusion models with cross-attention and the proposed conditional encoding generally outperform other methods under noisy conditions, although the deterministic method excels with noiseless data. Additionally, both the diffusion models and the deterministic method surpass the numerical approach in accuracy and computational cost for the steady problem. We also demonstrate the ability of the model to capture possible reconstructions and improve the accuracy of fused results in covariance-based correction tasks using ensemble sampling.

扩散模型场重建跨注意力稀疏观测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。