提出可学习时间编码方法,能自动捕捉复杂时间模式。
Rethinking Time Encoding via Learnable Transformation Functions
- 用可学习函数替代固定变换,动态建模时间模式
- 在多领域实验中表现优于传统方法,泛化性强
- 适合需要灵活建模时间依赖的场景,如时序预测
有效建模时间信息并将其融入涉及时间序列事件的应用或模型中至关重要。现实世界中的时间模式多样且复杂,对时间编码方法构成挑战。以往方法多聚焦于特定模式(如周期性),依赖如三角函数等先验假设,难以应对真实场景的多样性。本文提出可学习变换的通用时间编码(LeTE),采用深度函数学习技术参数化时间编码中的非线性变换,使其可学习并能建模多样复杂的时序动态。该方法将已有方法作为特例包含在内,支持无缝集成到多种任务中。在多个领域的广泛实验验证了其有效性与通用性。
原文摘要 · Abstract (English)
Effectively modeling time information and incorporating it into applications or models involving chronologically occurring events is crucial. Real-world scenarios often involve diverse and complex time patterns, which pose significant challenges for time encoding methods. While previous methods focus on capturing time patterns, many rely on specific inductive biases, such as using trigonometric functions to model periodicity. This narrow focus on single-pattern modeling makes them less effective in handling the diversity and complexities of real-world time patterns. In this paper, we investigate to improve the existing commonly used time encoding methods and introduce Learnable Transformation-based Generalized Time Encoding (LeTE). We propose using deep function learning techniques to parameterize non-linear transformations in time encoding, making them learnable and capable of modeling generalized time patterns, including diverse and complex temporal dynamics. By enabling learnable transformations, LeTE encompasses previous methods as specific cases and allows seamless integration into a wide range of tasks. Through extensive experiments across diverse domains, we demonstrate the versatility and effectiveness of LeTE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。