开源双语图像生成模型,中文字符渲染更准更快。
LongCat-Image Technical Report
- 三阶段数据精炼+奖励模型协同,提升图文一致性和真实感。
- 60亿参数小模型实现顶尖中文字符覆盖与准确率。
- 全链路开源,支持快速部署与社区共创。
我们推出LongCat-Image,首个开源双语(中英)图像生成基础模型,旨在解决当前主流模型在多语言文本渲染、逼真度、部署效率和开发者友好性方面的核心问题。1)通过预训练、中期训练和SFT阶段的严格数据筛选,结合强化学习阶段的优化奖励模型,构建新SOTA,显著提升文本渲染能力、美学质量与真实感。2)在中文字符渲染上树立行业新标准,支持复杂罕见汉字,覆盖范围和准确率均超越主流开源与商业方案。3)采用仅60亿参数的紧凑扩散模型,远小于常见的近200亿或更大规模MoE架构,实现低显存占用与快速推理,大幅降低部署成本。此外,在图像编辑任务上也达到开源模型最优表现,编辑一致性优于同类工作。4)建立迄今最完整的开源生态,发布多版本text-to-image与图像编辑模型,包括中期与后期训练检查点,以及全套训练工具链。我们认为其开放性将有力支撑开发者与研究者,推动视觉内容创作边界拓展。
原文摘要 · Abstract (English)
We introduce LongCat-Image, a pioneering open-source and bilingual (Chinese-English) foundation model for image generation, designed to address core challenges in multilingual text rendering, photorealism, deployment efficiency, and developer accessibility prevalent in current leading models. 1) We achieve this through rigorous data curation strategies across the pre-training, mid-training, and SFT stages, complemented by the coordinated use of curated reward models during the RL phase. This strategy establishes the model as a new state-of-the-art (SOTA), delivering superior text-rendering capabilities and remarkable photorealism, and significantly enhancing aesthetic quality. 2) Notably, it sets a new industry standard for Chinese character rendering. By supporting even complex and rare characters, it outperforms both major open-source and commercial solutions in coverage, while also achieving superior accuracy. 3) The model achieves remarkable efficiency through its compact design. With a core diffusion model of only 6B parameters, it is significantly smaller than the nearly 20B or larger Mixture-of-Experts (MoE) architectures common in the field. This ensures minimal VRAM usage and rapid inference, significantly reducing deployment costs. Beyond generation, LongCat-Image also excels in image editing, achieving SOTA results on standard benchmarks with superior editing consistency compared to other open-source works. 4) To fully empower the community, we have established the most comprehensive open-source ecosystem to date. We are releasing not only multiple model versions for text-to-image and image editing, including checkpoints after mid-training and post-training stages, but also the entire toolchain of training procedure. We believe that the openness of LongCat-Image will provide robust support for developers and researchers, pushing the frontiers of visual content creation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。