arXiv:2503.02799cs.CV2025-03中稿 · ICASSP 2025被引 5

提升少样本字体生成效果,让低资源语言字体更逼真。

MX-Font++: Mixture of Heterogeneous Aggregation Experts for Few-shot Font Generation

  • 用异构聚合专家增强特征提取,更好分离字形内容与风格。
  • 在多个数据集上优于现有方法,生成字体更自然清晰。
  • 适合做多语言AI字体生成或数字无障碍系统的研究者。

少样本字体生成(FFG)旨在用少量参考字形创建新字体库,在多语言人工智能系统中对低资源语言的数字可访问性和公平性至关重要。尽管现有方法表现良好,但在未见字符和风格差异大的情况下仍面临挑战。MX-Font从局部组件视角出发,采用专家混合(MoE)自适应提取组件以改善泛化,但缺乏鲁棒特征提取器导致内容与风格解耦不足。为此,本文提出异构聚合专家(HAE),通过通道与空间维度聚合信息,有效分离内容与风格;同时引入新颖的内容-风格同质性损失,进一步强化解耦。在多个数据集上的大量实验表明,MX-Font++ 在少样本字体生成任务中实现更优视觉效果,显著超越当前最先进方法。代码与数据已开源于 https://github.com/stephensun11/MXFontpp。

原文摘要 · Abstract (English)

Few-shot Font Generation (FFG) aims to create new font libraries using limited reference glyphs, with crucial applications in digital accessibility and equity for low-resource languages, especially in multilingual artificial intelligence systems. Although existing methods have shown promising performance, transitioning to unseen characters in low-resource languages remains a significant challenge, especially when font glyphs vary considerably across training sets. MX-Font considers the content of a character from the perspective of a local component, employing a Mixture of Experts (MoE) approach to adaptively extract the component for better transition. However, the lack of a robust feature extractor prevents them from adequately decoupling content and style, leading to sub-optimal generation results. To alleviate these problems, we propose Heterogeneous Aggregation Experts (HAE), a powerful feature extraction expert that helps decouple content and style downstream from being able to aggregate information in channel and spatial dimensions. Additionally, we propose a novel content-style homogeneity loss to enhance the untangling. Extensive experiments on several datasets demonstrate that our MX-Font++ yields superior visual results in FFG and effectively outperforms state-of-the-art methods. Code and data are available at https://github.com/stephensun11/MXFontpp.

字体生成少样本学习风格分离

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。