arXiv:2601.05259cs.IR2026-01

用简单模型+提示工程实现多语言电商搜索相关性判断

A Technical Report on the Second Place Solution for the CIKM 2025 AnalytiCup Competition

  • 拆解判断流程为四步,用提示词引导大模型推理
  • 单模型每秒处理20条,准确率在公开/私有榜单分别达0.8902和0.8889
  • 轻量微调+可解释路径,适合工业级部署

本文针对电商搜索中多语言类别相关性判断的挑战,提出一种简化而高效的框架。传统集成系统虽提升准确率,但训练、推理与维护成本高昂。为此,我们采用提示工程结合思维链任务分解,在单一大语言模型中引导推理。具体将相关性判断过程拆分为翻译、意图理解、类别匹配与最终判断四个可解释子任务,并基于Qwen2.5-14B模型使用低秩适配(LoRA)进行高效微调。该设计显著降低计算与存储开销,同时提升推理路径可解释性。实验表明,该单模型框架在单张A100 GPU上实现每秒20样本的高推理效率,于CIKM 2025 AnalytiCup竞赛中,公开榜单得分0.8902,私有榜单得分0.8889,验证了方法的有效性与鲁棒性。结果表明,结构化提示配合轻量微调可超越复杂集成系统,为可扩展的工业级AI应用提供新范式。

原文摘要 · Abstract (English)

In this work, we address the challenge of multilingual category relevance judgment in e-commerce search, where traditional ensemble-based systems improve accuracy but at the cost of heavy training, inference, and maintenance complexity. To overcome this limitation, we propose a simplified yet effective framework that leverages prompt engineering with Chain-of-Thought task decomposition to guide reasoning within a single large language model. Specifically, our approach decomposes the relevance judgment process into four interpretable subtasks: translation, intent understanding, category matching, and relevance judgment -- and fine-tunes a base model (Qwen2.5-14B) using Low-Rank Adaptation (LoRA) for efficient adaptation. This design not only reduces computational and storage overhead but also enhances interpretability by explicitly structuring the model's reasoning path. Experimental results show that our single-model framework achieves competitive accuracy and high inference efficiency, processing 20 samples per second on a single A100 GPU. In the CIKM 2025 AnalytiCup Competition Proposals, our method achieved 0.8902 on the public leaderboard and 0.8889 on the private leaderboard, validating the effectiveness and robustness of the proposed approach. These results highlight that structured prompting combined with lightweight fine-tuning can outperform complex ensemble systems, offering a new paradigm for scalable industrial AI applications.

大模型应用提示工程多语言电商搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。