用强化学习同时做时间特征提取与降维,提升预测模型效果。
TemporalPaD: a reinforcement-learning framework for temporal feature representation and dimension reduction
- 结合强化学习与神经网络,端到端实现特征提取与降维。
- 在29个UCI数据集上验证,显著提升分类性能。
- 适合处理时序数据,如基因增强子分类任务。
近年来,特征表示与降维在提升预测建模效率方面发挥了关键作用。本文提出TemporalPaD,一种专为时间模式数据设计的端到端深度学习框架,通过将强化学习(RL)与神经网络结合,实现特征表示与降维的协同优化。该框架包含三个协作模块:策略模块(作为行动者)、表示模块(用于特征提取)和分类模块(共同作为评价者),基于动作-评判(Actor-Critic, AC)框架构建。我们在29个著名的UCI数据集上进行了全面评估,这些数据集是验证降维算法的标准基准,采用10次独立测试与10折交叉验证。此外,鉴于TemporalPaD专为时序数据设计,我们将其应用于真实的DNA分类问题,涉及增强子类别与增强子强度的判别。结果表明,TemporalPaD是一种高效且有效的特征降维框架,适用于结构化数据与序列数据。本文提供的源代码可免费获取,详见附录及http://www.healthinformaticslab.org/supp/。
原文摘要 · Abstract (English)
Recent advancements in feature representation and dimension reduction have highlighted their crucial role in enhancing the efficacy of predictive modeling. This work introduces TemporalPaD, a novel end-to-end deep learning framework designed for temporal pattern datasets. TemporalPaD integrates reinforcement learning (RL) with neural networks to achieve concurrent feature representation and feature reduction. The framework consists of three cooperative modules: a Policy Module, a Representation Module, and a Classification Module, structured based on the Actor-Critic (AC) framework. The Policy Module, responsible for dimensionality reduction through RL, functions as the actor, while the Representation Module for feature extraction and the Classification Module collectively serve as the critic. We comprehensively evaluate TemporalPaD using 29 UCI datasets, a well-known benchmark for validating feature reduction algorithms, through 10 independent tests and 10-fold cross-validation. Additionally, given that TemporalPaD is specifically designed for time series data, we apply it to a real-world DNA classification problem involving enhancer category and enhancer strength. The results demonstrate that TemporalPaD is an efficient and effective framework for achieving feature reduction, applicable to both structured data and sequence datasets. The source code of the proposed TemporalPaD is freely available as supplementary material to this article and at http://www.healthinformaticslab.org/supp/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。