用生成式AI自动造图并标注,省去人工数据标注难题
Automated Image Recognition Framework
- 通过生成与增强双模块自动构建带标注图像数据集
- 在多个任务上训练模型表现优异,用户评分达4.4/5.0
- 适合数据稀缺或敏感领域,降低模型开发门槛
深度学习模型的性能高度依赖数据,但针对新主题或敏感内容收集和标注数据仍面临巨大时间与资源挑战。为此,我们提出自动化图像识别框架(AIR),利用生成式AI实现高质量、预标注数据集的自动生成,无需人工标注。AIR包含两个核心数据合成流程:AIR-Gen可按需生成定制数据集,并引入基于大语言模型的自动化提示工程模块提升图像质量;同时采用分布调整算法消除重复与异常样本,提高数据可靠性。AIR-Aug则用于扩充现有数据集,显著提升分类器性能,尤其适用于数据有限的任务。实验表明,使用生成数据训练的模型具备强大识别能力,用户研究得分高达4.4/5.0,显示该系统在多种物体识别场景中的广泛潜力。
原文摘要 · Abstract (English)
While the efficacy of deep learning models heavily relies on data, gathering and annotating data for specific tasks, particularly when addressing novel or sensitive subjects lacking relevant datasets, poses significant time and resource challenges. In response to this, we propose a novel Automated Image Recognition (AIR) framework that harnesses the power of generative AI. AIR empowers end-users to synthesize high-quality, pre-annotated datasets, eliminating the necessity for manual labeling. It also automatically trains deep learning models on the generated datasets with robust image recognition performance. Our framework includes two main data synthesis processes, AIR-Gen and AIR-Aug. The AIR-Gen enables end-users to seamlessly generate datasets tailored to their specifications. To improve image quality, we introduce a novel automated prompt engineering module that leverages the capabilities of large language models. We also introduce a distribution adjustment algorithm to eliminate duplicates and outliers, enhancing the robustness and reliability of generated datasets. On the other hand, the AIR-Aug enhances a given dataset, thereby improving the performance of deep classifier models. AIR-Aug is particularly beneficial when users have limited data for specific tasks. Through comprehensive experiments, we demonstrated the efficacy of our generated data in training deep learning models and showcased the system's potential to provide image recognition models for a wide range of objects. We also conducted a user study that achieved an impressive score of 4.4 out of 5.0, underscoring the AI community's positive perception of AIR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。