arXiv:2601.01383cs.LGcs.AI2026-01

用数据特性预判模型表现,省时省力。

Data Complexity-aware Deep Model Performance Forecasting

  • 先分析数据特征定基准,再结合模型结构调优
  • 预测准确率误差小于10%,跨数据集通用
  • 能提前发现数据问题,指导模型选型与预处理

深度学习模型在计算机视觉等领域广泛应用。但为特定数据集选择合适架构常需反复试错,耗时耗资源且难自动化。现有性能预测方法多依赖部分训练或复杂仿真,计算开销大或泛化能力差。本文提出一种轻量级两阶段框架,仅凭数据特性和模型结构即可预测训练前的性能表现。第一阶段基于数据可测量属性(如方差)建立基线预测;第二阶段引入模型架构与超参数信息进行修正。该框架具备跨数据集、跨模型类型的泛化能力。我们发现,诸如数据方差等底层特征不仅能提升预测精度,还可作为数据质量的早期指示器,从而在训练前辅助模型选型、预处理决策及异常数据检测。

原文摘要 · Abstract (English)

Deep learning models are widely used across computer vision and other domains. When working on the model induction, selecting the right architecture for a given dataset often relies on repetitive trial-and-error procedures. This procedure is time-consuming, resource-intensive, and difficult to automate. While previous work has explored performance prediction using partial training or complex simulations, these methods often require significant computational overhead or lack generalizability. In this work, we propose an alternative approach: a lightweight, two-stage framework that can estimate model performance before training given the understanding of the dataset and the focused deep model structures. The first stage predicts a baseline based on the analysis of some measurable properties of the dataset, while the second stage adjusts the estimation with additional information on the model's architectural and hyperparameter details. The setup allows the framework to generalize across datasets and model types. Moreover, we find that some of the underlying features used for prediction - such as dataset variance - can offer practical guidance for model selection, and can serve as early indicators of data quality. As a result, the framework can be used not only to forecast model performance, but also to guide architecture choices, inform necessary preprocessing procedures, and detect potentially problematic datasets before training begins.

性能预测数据质量模型选择轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。