arXiv:2505.24595cs.LGcs.AI2025-05

用二进制序数编码提升时序预测精度与效率

BinConv: A Neural Architecture for Ordinal Encoding in Time-Series Forecasting

  • 采用累积二进制编码,保留目标值的顺序与距离信息
  • 提出全卷积架构BinConv,比全连接层更高效且更准确
  • 在多个基准数据集上优于主流模型,参数少、训练快

近期研究将时序预测中的回归任务重新构想为分类问题,通过将连续目标空间离散化为若干区间并预测固定类别,从而获得更稳定的训练过程、更好的不确定性建模能力,并兼容现代深度学习架构。然而,现有方法多依赖独热编码,忽略了目标值间的固有序数结构,导致训练过程中无法传递预测值与真实值之间的相对距离信息。为此,本文提出累积二进制编码(Cumulative Binary Encoding, CBE),一种单调的二进制表示方法,用于转换模型输入与输出。CBE 隐式保留了序数与量级信息,使模型在分类框架下仍能学习距离感知的表示。为有效利用CBE,我们设计了专用于概率预测的全卷积神经网络架构 BinConv。实验表明,标准全连接层在使用CBE时不仅计算效率更低,还会降低预测性能。在多个标准基准数据集上的实验显示,BinConv 在点预测和概率预测任务中均优于广泛使用的基线模型,同时参数更少、训练更快。

原文摘要 · Abstract (English)

Recent work in time series forecasting has explored reformulating regression as a classification task. By discretizing the continuous target space into bins and predicting over a fixed set of classes, these approaches benefit from more stable training, improved uncertainty modeling, and compatibility with modern deep learning architectures. However, most existing methods rely on one-hot encoding, which ignores the inherent ordinal structure of the target values. As a result, they fail to convey information about the relative distance between predicted and true values during training. In this paper, we address this limitation by applying \textbf{Cumulative Binary Encoding} (CBE), a monotonic binary representation that transforms both model inputs and outputs. CBE implicitly preserves ordinal and magnitude information, allowing models to learn distance aware representations while operating within a classification framework. To leverage CBE effectively, we propose \textbf{BinConv}, a fully convolutional neural network architecture designed for probabilistic forecasting. We demonstrate that standard fully connected layers are not only less computationally efficient than convolutional layers when used with CBE, but also degrade forecasting performance. Our experiments on standard benchmark datasets show that BinConv achieves superior performance compared to widely used baselines in both point and probabilistic forecasting, while requiring fewer parameters and enabling faster training.

时序预测序数编码卷积网络概率建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。