构建1亿对高质量中英图文数据集,助力中文多模态模型发展
DanQing: An Up-to-Date Large-Scale Chinese Vision-Language Pre-training Dataset
- 从网页抓取构建1亿对中文图文数据,采用四步质量控制流程
- 在零样本分类等任务上超越现有中文数据集,提升模型性能
- 数据覆盖2024-2025年新概念,适合中文多模态研究者使用
视觉-语言预训练(VLP)模型通过大规模图像-文本对取得了显著进展。尽管英语模型如CLIP和SigLIP得益于海量数据(如LAION-400M),但中文VLP的发展受限于高质量、大规模开源数据的缺乏。本文提出DanQing,一个包含1亿条高质量图像-文本对的大型中文跨模态数据集,数据源自Common Crawl。为保障数据质量,我们设计了系统化流程:数据源筛选、文本优化、视觉多样性增强及跨模态跨批次过滤,有效降低网络数据固有噪声。值得注意的是,DanQing涵盖2024–2025年数据,使模型能捕捉当代语义趋势与新兴概念。通过持续预训练SigLIP2模型的大量实验表明,DanQing在零样本分类、跨模态检索及中文多模态任务中均持续优于现有中文数据集。深入分析显示,DanQing具有更均衡的语义分布和更强的可扩展性。为促进中文多模态预训练研究,我们将以Creative Commons CC-BY-NC 4.0许可证开源DanQing数据集。
原文摘要 · Abstract (English)
Vision-Language Pre-training (VLP) models have achieved remarkable success by leveraging large-scale image-text pairs. While English-centric models like CLIP and SigLIP benefit from massive datasets (e.g., LAION-400M), the development of Chinese VLP remains bottlenecked by the lack of high-quality, large-scale open-source data. In this paper, we present DanQing, a large-scale Chinese cross-modal dataset containing 100 million high-quality image-text pairs curated from Common Crawl. To ensure superior data quality, we develop an effective systematic pipeline comprising data source selection, text refinement, visual diversification, and cross-modal cross-batch filtering, thereby effectively mitigating the intrinsic noise prevalent in web data. Notably, DanQing incorporates data from 2024-2025, enabling models to capture contemporary semantic trends and emerging concepts. Extensive experiments via continued pretraining of SigLIP2 models demonstrate that DanQing consistently outperforms existing Chinese datasets across diverse downstream tasks, including zero-shot classification, cross-modal retrieval, and Chinese-centric large multimodal model tasks. Furthermore, in-depth analysis of DanQing reveals that it exhibits a more balanced semantic distribution and superior scaling capability compared to existing datasets. To facilitate further research in Chinese vision-language pre-training, we will open-source the DanQing dataset under the Creative Common CC-BY-NC 4.0 license.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。