arXiv:2505.06316cs.LG2025-05

用图神经网络压缩科学数据,保证误差上限同时提升压缩率。

GraphComp: Extreme Error-bounded Compression of Scientific Data via Temporal Graph Autoencoders

  • 将数据转为保留时空关联的图结构,再用时序图自编码器降维
  • 在真实与合成数据上压缩率最高,比次优方法高出22%~50%
  • 适合需要高保真压缩的科学计算、气候模拟等场景

海量科学数据的生成给存储、传输和分析带来挑战。近年来,有界误差的有损压缩方法因其高压缩比和可控失真而受到关注,但常忽略数据内在的空间与时间相关性,错失更高压缩潜力。本文提出GRAPHCOMP,一种基于图的有界误差科学数据压缩方法。对原始网格数据进行不规则分割,构建保留时空相关性的图表示;借鉴图神经网络思想,设计时序图自编码器学习低维隐含表示,显著压缩图规模,实现原始数据的有效压缩。解压过程反向操作,结合学习到的图模型与隐含表示重构原数据近似值,且保证点级误差满足用户设定上限。在大规模真实与合成数据上对比最新有界误差压缩方法(HPEZ、SZ3.1、SPERR、ZFP),GRAPHCOMP在多数数据集上均取得最高压缩比,超越次优方法22%至50%。

原文摘要 · Abstract (English)

The generation of voluminous scientific data poses significant challenges for efficient storage, transfer, and analysis. Recently, error-bounded lossy compression methods emerged due to their ability to achieve high compression ratios while controlling data distortion. However, they often overlook the inherent spatial and temporal correlations within scientific data, thus missing opportunities for higher compression. In this paper we propose GRAPHCOMP, a novel graph-based method for error-bounded lossy compression of scientific data. We perform irregular segmentation of the original grid data and generate a graph representation that preserves the spatial and temporal correlations. Inspired by Graph Neural Networks (GNNs), we then propose a temporal graph autoencoder to learn latent representations that significantly reduce the size of the graph, effectively compressing the original data. Decompression reverses the process and utilizes the learnt graph model together with the latent representation to reconstruct an approximation of the original data. The decompressed data are guaranteed to satisfy a user-defined point-wise error bound. We compare our method against the state-of-the-art error-bounded lossy methods (i.e., HPEZ, SZ3.1, SPERR, and ZFP) on large-scale real and synthetic data. GRAPHCOMP consistently achieves the highest compression ratio across most datasets, outperforming the second-best method by margins ranging from 22% to 50%.

数据压缩图神经网络科学计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。