系统梳理多标签图像分类的深度学习方法与挑战。
Rethinking Multi-Label Image Classification With Deep Learning: Taxonomy, Challenge, and Outlook

- 按方法思路将模型分为六类,结构化归纳技术路径
- 总结当前主流数据集与评估指标,揭示性能瓶颈
- 适合计算机视觉研究者和多标签任务开发者参考
多标签图像分类(MLIC)是计算机视觉的基础任务,旨在识别图像中多个对象或概念,广泛应用于自动驾驶、疾病诊断、推荐系统和移动服务机器人等场景。过去十年中,基于卷积神经网络、循环神经网络和Transformer的深度学习范式显著推动了该领域发展,凭借其强大的视觉表征与关系建模能力,大幅提升了模型在不同数据集和应用中的鲁棒性、可扩展性和泛化能力。本文全面综述了基于深度学习的MLIC研究文献。首先回顾问题定义、数据集、主干网络和评估指标;其次构建了一个合理的分类体系,将现有方法分为六类:区域导向型、标签导向型、架构导向型、表示导向型、学习导向型和数据导向型;最后深入剖析MLIC背后的“学习博弈”机制及其对其他视觉任务的启示,实证总结关键挑战与未来研究方向。我们认为本综述为研究社区提供了系统性的视角,有助于推动该领域及更广泛视觉研究的持续创新。
原文摘要 · Abstract (English)
Multi-label image classification (MLIC), a fundamental task in computer vision, focuses on identifying multiple objects or concepts within an image, underpinning numerous read-world applications, such as autonomous driving, disease diagnosis, recommendation system, and mobile service robot. Over the past decade, deep learning paradigms based on convolutional neural networks, recurrent neural networks, and Transformers have significantly advanced this field, owing to their powerful capability in visual representation and relationship modeling. These advances have markedly improved the robustness, scalability, and generalization ability of MLIC models across diverse datasets and application domains. In this survey, we provide a comprehensive review of the deep learning-based literature on MLIC. Concretely, we first revisit the background, including problem definition, datasets, backbones and evaluation metrics. Next, we develop a plausible taxonomy for the deep learning-based MLIC approaches, organizing them into six groups: region-oriented methods, label-oriented methods, architecture-oriented methods, representation-oriented methods, learning-oriented methods, and data-oriented methods. Finally, we provide an insightful exposition of the underlying learning game in MLIC and its implications for other vision domains, and we empirically summarize the key challenges and research directions in MLIC while outlining promising avenues for future development. We believe this survey offers the research community a holistic and systematic perspective on MLIC, thereby facilitating subsequent exploration and innovation in this field and beyond.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。