arXiv:2411.15216cs.LGcs.AI2024-11ICLR被引 4

提出新损失函数Dist Loss,提升少样本区域回归精度

Dist Loss: Enhancing Regression in Few-Shot Region through Distribution Distance Constraint

  • 通过最小化预测与标签的分布距离来约束模型输出
  • 在三个数据集上显著提升少样本区域的回归性能
  • 适合医疗等少样本数据场景的模型优化

现实场景中数据分布不均普遍存在,严重影响不平衡分类与回归任务。深度模型常在高密度区域过拟合,在低密度区域表现不佳,制约其在医疗等领域的应用。尽管已有研究将分布信息引入不平衡分类,但回归任务仍缺乏类似方法。本文提出新型损失函数Dist Loss,以可微方式最小化模型预测与目标标签间的分布距离,将分布信息融入训练过程。该方法使模型在训练中正则化输出分布,增强对少样本区域的关注。我们在计算机视觉和医疗领域三个数据集(IMDB-WIKI-DIR、AgeDB-DIR、ECG-Ka-DIR)上进行了广泛实验,结果表明Dist Loss能有效缓解数据分布不均带来的负面影响,在稀疏数据区域达到当前最优性能。此外,该方法易于集成,可与现有方法协同使用。

原文摘要 · Abstract (English)

Imbalanced data distributions are prevalent in real-world scenarios, posing significant challenges in both imbalanced classification and imbalanced regression tasks. They often cause deep learning models to overfit in areas of high sample density (many-shot regions) while underperforming in areas of low sample density (few-shot regions). This characteristic restricts the utility of deep learning models in various sectors, notably healthcare, where areas with few-shot data hold greater clinical relevance. While recent studies have shown the benefits of incorporating distribution information in imbalanced classification tasks, such strategies are rarely explored in imbalanced regression. In this paper, we address this issue by introducing a novel loss function, termed Dist Loss, designed to minimize the distribution distance between the model's predictions and the target labels in a differentiable manner, effectively integrating distribution information into model training. Dist Loss enables deep learning models to regularize their output distribution during training, effectively enhancing their focus on few-shot regions. We have conducted extensive experiments across three datasets spanning computer vision and healthcare: IMDB-WIKI-DIR, AgeDB-DIR, and ECG-Ka-DIR. The results demonstrate that Dist Loss effectively mitigates the negative impact of imbalanced data distribution on model performance, achieving state-of-the-art results in sparse data regions. Furthermore, Dist Loss is easy to integrate, complementing existing methods.

回归任务少样本学习分布对齐医疗影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。