arXiv:2504.12503cs.LGcs.AI2025-04被引 5

为工程回归问题设计持续学习方案,有效缓解遗忘并节省训练时间。

Continual Learning Strategies for 3D Engineering Regression Problems: A Benchmarking Study

  • 引入多种持续学习策略,应对工程数据随时间演进的挑战。
  • 回放策略性能接近重新训练,训练时间减少近一半。
  • 构建9个新工程持续学习基准,适合实际工程场景应用。

工程领域机器学习常面临计算成本高、数据集有限的问题。随着新设计和约束的出现,模型需持续学习新知识,但重新训练代价过大。持续学习(CL)通过顺序学习缓解灾难性遗忘,实现高效更新。本文首次将CL应用于工程设计,对多个主流方法在代表性回归任务中进行基准测试。我们使用五个工程数据集,构建九个新的工程持续学习基准,评估其抗遗忘能力与泛化性能。初步结果表明,现有CL方法优于基础方法;其中回放策略在多个基准上表现接近重新训练,训练时间减少近半,展现出在真实工程流程中的潜力。代码与数据集将在https://github.com/kmsamuel/cl-for-engineering-release公开。

原文摘要 · Abstract (English)

Engineering problems that apply machine learning often involve computationally intensive methods but rely on limited datasets. As engineering data evolves with new designs and constraints, models must incorporate new knowledge over time. However, high computational costs make retraining models from scratch infeasible. Continual learning (CL) offers a promising solution by enabling models to learn from sequential data while mitigating catastrophic forgetting, where a model forgets previously learned mappings. This work introduces CL to engineering design by benchmarking several CL methods on representative regression tasks. We apply these strategies to five engineering datasets and construct nine new engineering CL benchmarks to evaluate their ability to address forgetting and improve generalization. Preliminary results show that applying existing CL methods to these tasks improves performance over naive baselines. In particular, the Replay strategy achieved performance comparable to retraining in several benchmarks while reducing training time by nearly half, demonstrating its potential for real-world engineering workflows. The code and datasets used in this work will be available at: https://github.com/kmsamuel/cl-for-engineering-release.

持续学习工程建模回归任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。