arXiv:2504.04242cs.LGcs.CV2025-04综述被引 6

系统梳理视觉任务中损失函数的设计与应用,助你选对损失提升模型表现。

Task-based Loss Functions in Computer Vision: A Comprehensive Review

  • 按任务类型分类梳理常见损失函数及其数学原理
  • 覆盖从基础到前沿的损失设计,含对抗与扩散损失
  • 适合研究者和工程师在模型调参时参考选择

损失函数是深度学习的核心,决定模型如何学习与优化。本文全面回顾了各类损失函数,从均方误差、交叉熵等基础形式,到对抗损失、扩散损失等先进方法。系统分析其数学基础、对训练过程的影响,并针对计算机视觉(判别与生成)、表格数据预测、时间序列预测等应用场景,总结最新进展中的主流损失函数。同时探讨损失函数的历史演进、计算效率及设计挑战,强调在多模态数据、类别不平衡与实际约束等复杂场景下的适应性需求。最后指出未来方向:提升可解释性、可扩展性与泛化能力,推动更鲁棒高效的深度学习模型发展。

原文摘要 · Abstract (English)

Loss functions are at the heart of deep learning, shaping how models learn and perform across diverse tasks. They are used to quantify the difference between predicted outputs and ground truth labels, guiding the optimization process to minimize errors. Selecting the right loss function is critical, as it directly impacts model convergence, generalization, and overall performance across various applications, from computer vision to time series forecasting. This paper presents a comprehensive review of loss functions, covering fundamental metrics like Mean Squared Error and Cross-Entropy to advanced functions such as Adversarial and Diffusion losses. We explore their mathematical foundations, impact on model training, and strategic selection for various applications, including computer vision (Discriminative and generative), tabular data prediction, and time series forecasting. For each of these categories, we discuss the most used loss functions in the recent advancements of deep learning techniques. Also, this review explore the historical evolution, computational efficiency, and ongoing challenges in loss function design, underlining the need for more adaptive and robust solutions. Emphasis is placed on complex scenarios involving multi-modal data, class imbalances, and real-world constraints. Finally, we identify key future directions, advocating for loss functions that enhance interpretability, scalability, and generalization, leading to more effective and resilient deep learning models.

损失函数计算机视觉深度学习模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。