arXiv:2606.16981cs.DBcs.LG2026-06

通过概率稀释,让数据流推理与状态更新解耦,大幅降低延迟和存储开销。

Decoupling Inference from State Updates in Low-Latency Feature Engines via Probabilistic Thinning

论文配图:Decoupling Inference from State Updates in Low-Latency Feature Engines via Probabilistic Thinning
图 1 · 摘自论文原文
  • 用概率方式筛选事件,只对关键事件写入持久化存储。
  • 实验显示90%事件可跳过存储路径,仍保持甚至提升下游效果。
  • 无需高频内存控制或跨工作节点协调,适合高并发流式系统。

流式数据系统日益支撑需持续更新大量聚合的机器学习工作流。生产环境中,每个事件通常触发读-修改-写操作至持久存储,导致高频状态更新成为延迟、竞争与运营成本的主要来源。本文提出通过概率稀释,将推理与状态持久化解耦:每个事件被评分,但仅由信息量高的事件触发持久化更新。不同于丢弃输入或状态的方法,我们证明无需高频内存控制平面或跨工作节点协调,仅依赖磁盘键值存储中的近似统计即可实现持久化路径控制。我们建模了由此产生的随机过程,推导出过滤率边界,并证明在方差感知公式下,常见基于时间的聚合仍无偏,防止系统性误差累积。在隔离单事件成本的受控环境下评估,该方法显著降低了存储输入/输出与序列化开销。实验中,高达90%的事件被排除在持久化路径外,同时保持甚至提升了下游效用。

原文摘要 · Abstract (English)

Streaming data systems increasingly underpin Machine Learning workflows that maintain large numbers of continuously updated aggregations. In production settings, each incoming event typically triggers read-modify-write operations to persistent storage, making high-frequency state updates a dominant source of latency, contention, and operational cost. In this work, we decouple inference from state persistence in streaming Machine Learning pipelines via probabilistic thinning: every event is scored, but durable state updates are selectively triggered by informative events. Unlike approaches that shed input or state, we show that persistence-path control is achievable without a high-frequency in-memory control plane or cross-worker coordination, relying exclusively on approximate statistics retrieved from disk-backed key-value stores. We model the resulting stochastic processes, derive bounds on filtering rates, and prove that common time-based aggregations remain unbiased under variance-aware formulations, preventing systemic error accumulation. We evaluate the approach in a controlled setting that isolates per-event costs, demonstrating substantial reductions in storage Input/Output and serialization overhead. Across experiments, up to 90% of events are excluded from the persistence path while preserving and in some cases improving downstream utility.

流式计算状态管理低延迟概率稀释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。