arXiv:2412.16266cs.LGcs.DB2024-12中稿 · publication in Pro…被引 12

用非线性函数分段逼近时间序列,实现高效压缩与随机访问。

Learned Compression of Nonlinear Time Series With Random Access

  • 用分区算法选取不同形状的非线性函数逼近时间序列,最小化存储空间。
  • 相比现有有损压缩方法,压缩率提升最高达14%;比无损压缩更快解压。
  • 适合需要实时分析海量历史时间序列的金融、医疗等场景。

时间序列在金融、医疗、工业和环境监测等领域至关重要,但其持续增长导致存储和检索困难,常被迫丢弃历史数据。通用压缩器虽压缩率高,却无法高效随机访问;专用流式方案则牺牲压缩效果和随机访问能力。现有方法忽视时间序列中常见的线性与非线性趋势规律。为此,本文提出NeaTS,一种可随机访问的压缩方案:通过分区算法选择不同类型的非线性函数序列逼近时间序列,使残差有界,从而以极小空间存储残差,实现无损恢复或按最大误差控制丢弃,获得有损表示。实验表明,NeaTS在压缩率上比现有使用线性/非线性函数的最优有损压缩器最高提升14%;相比无损压缩器,它兼具接近或优于最佳的压缩率、更快的解压速度以及数量级更高的随机访问效率,首次同时满足大规模历史时间序列的存储与实时分析需求。

原文摘要 · Abstract (English)

Time series play a crucial role in many fields, including finance, healthcare, industry, and environmental monitoring. The storage and retrieval of time series can be challenging due to their unstoppable growth. In fact, these applications often sacrifice precious historical data to make room for new data. General-purpose compressors can mitigate this problem with their good compression ratios, but they lack efficient random access on compressed data, thus preventing real-time analyses. Ad-hoc streaming solutions, instead, typically optimise only for compression and decompression speed, while giving up compression effectiveness and random access functionality. Furthermore, all these methods lack awareness of certain special regularities of time series, whose trends over time can often be described by some linear and nonlinear functions. To address these issues, we introduce NeaTS, a randomly-accessible compression scheme that approximates the time series with a sequence of nonlinear functions of different kinds and shapes, carefully selected and placed by a partitioning algorithm to minimise the space. The approximation residuals are bounded, which allows storing them in little space and thus recovering the original data losslessly, or simply discarding them to obtain a lossy time series representation with maximum error guarantees. Our experiments show that NeaTS improves the compression ratio of the state-of-the-art lossy compressors that use linear or nonlinear functions (or both) by up to 14%. Compared to lossless compressors, NeaTS emerges as the only approach to date providing, simultaneously, compression ratios close to or better than the best existing compressors, a much faster decompression speed, and orders of magnitude more efficient random access, thus enabling the storage and real-time analysis of massive and ever-growing amounts of (historical) time series data.

时间序列压缩随机访问非线性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。