针对多语言短文本分类,设计了按语言质量分级的低成本路由策略。
A Cost-Efficient Routing Pipeline for Multilingual Short-Text Classification Using Small Language Models
- 根据语言资源丰富程度分层,弱语言先翻译成英语再分类
- 弱语言准确率提升显著,最高达0.6828(原0.4632)
- 无需微调,适合资源有限但需多语言支持的系统部署
多语言短文本分类支撑内容审核、客服路由和意图识别等实际系统,但整体评估常掩盖高资源与低资源语言间的巨大差异。统一推理策略虽易部署,却假设所有语言表现均等。本文评估一种固定列表路由策略:强语言直接通过多语言路径,弱语言则经翻译至英语后进行零样本分类。该流水线完全自托管,使用预训练小型句向量编码器,无需任务微调。在两个不同规模与标签粒度的基准上测试:SIB-200的15种语言子集(7类主题分类)和MASSIVE的15地区子集(官方60意图分类)。在SIB-200上,最优配置R1仅翻译低资源语言,高/中资源语言宏平均F1不变,低资源语言宏平均F1从0.4632升至0.6828。在MASSIVE子集上,同策略使低资源语言宏平均F1从0.2143升至0.4417,但最佳整体结果来自全翻译配置R3,宏平均F1达0.4647。跨两基准,选择性翻译对弱语言有效,但最优路由边界依赖任务。因此,报告按层级质量与延迟的路由收益,而非单一全局效率指标。
原文摘要 · Abstract (English)
Multilingual short-text classification supports operational systems such as content moderation, customer support routing, and intent recognition, yet aggregate evaluation often hides large differences between high-resource and low-resource languages. Uniform inference policies are simple to deploy, but they assume that all languages are equally well served. In this work, we evaluate a fixed-list routing strategy that keeps stronger languages on a direct multilingual path and selectively sends weaker languages through translation into English before zero-shot classification. The pipeline is fully self-hosted, uses pretrained compact sentence encoders, and requires no task-specific fine-tuning. We test the approach on two benchmarks chosen to differ in scale and label granularity: a 15-language subset of SIB-200 for seven-way topic classification and a 15-locale subset of MASSIVE for intent classification over an official 60-intent inventory. On SIB-200, the best overall configuration is R1, which translates only the low-resource tier: high-tier and mid-tier Macro-F1 remain unchanged, while low-tier Macro-F1 rises from 0.4632 to 0.6828. On the MASSIVE subset, the same low-tier intervention raises low-tier Macro-F1 from 0.2143 to 0.4417, but the best overall result is obtained by full translation, R3, at Macro-F1 0.4647. Across these two benchmarks, selective translation is a reliable intervention for weaker languages, whereas the optimal routing boundary depends on the task. We therefore report routing through tier-level quality gains and tier-level latency rather than a single global efficiency score.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。