arXiv:2411.06499cs.LGcs.CV2024-11被引 1

解决非共位数据中的分布偏移问题,提升模型评估准确性

Mitigating covariate shift in non-colocated data with learned parameter priors

  • 通过学习参数先验,最小化片段间特征分布差异
  • 在40个数据集上实现比现有方法高5%~10%的准确率提升
  • 适合处理时间/空间分散数据的分类任务研究者

当训练数据分布在不同时间或空间片段时,片段间的协变量偏移会扭曲交叉验证结果,影响模型选择与评估。本文提出碎片诱导协变量偏移修复(FIcsR),通过最小化片段协变量分布与标准交叉验证基准之间的f-散度来缓解该问题,并揭示其与常见重要性加权方法的等价性。由于神经网络过参数化带来的计算挑战,我们推导出费舍尔信息近似,累积各片段的修正量后作为全局先验引入优化目标。在多个数据类别、40个数据集及多种序列长度下进行大量分类实验,并扩展至k折交叉验证设置。消融实验表明,在不同偏移程度下,使用FIcsR的模型退化更慢;所有条件下性能均显著优于当前最佳方法,批次和折级的准确率分别提升超过5%和10%。

原文摘要 · Abstract (English)

When training data are distributed across{ time or space,} covariate shift across fragments of training data biases cross-validation, compromising model selection and assessment. We present \textit{Fragmentation-Induced covariate-shift Remediation} ($FIcsR$), which minimizes an $f$-divergence between a fragment's covariate distribution and that of the standard cross-validation baseline. We s{how} an equivalence with popular importance-weighting methods. {The method}'s numerical solution poses a computational challenge owing to the overparametrized nature of a neural network, and we derive a Fisher Information approximation. When accumulated over fragments, this provides a global estimate of the amount of shift remediation thus far needed, and we incorporate that as a prior via the minimization objective. In the paper, we run extensive classification experiments on multiple data classes, over $40$ datasets, and with data batched over multiple sequence lengths. We extend the study to the $k$-fold cross-validation setting through a similar set of experiments. An ablation study exposes the method to varying amounts of shift and demonstrates slower degradation with $FIcsR$ in place. The results are promising under all these conditions; with improved accuracy against batch and fold state-of-the-art by more than $5\%$ and $10\%$, respectively.

分布偏移交叉验证深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。