arXiv:2502.11022cs.CLcs.AI2025-02ACL被引 9

首个多语言自然语言转NoSQL查询基准,解决跨语言数据查询难题

MultiTEND: A Multilingual Benchmark for Natural Language to NoSQL Query Translation

  • 构建六语种多语言基准,分步解析跨语言查询生成挑战
  • 非英语场景准确率低至4%-6%差距,现有模型普遍表现不佳
  • 提出MultiLink框架,融合推理与检索,提升各语言查询准确率

在大数据时代,自然语言接口对非结构化数据的访问日益重要,使用户无需技术背景即可操作复杂数据库。然而,现有研究主要聚焦英文,缺乏多语言支持。本文提出MultiTEND,首个覆盖英语、德语、法语、俄语、日语和中文的多语言自然语言转NoSQL查询基准。通过该基准,分析了不同语言在词汇与句法上的差异带来的挑战。实验表明,在微调小模型、零样本大模型及基于检索增强的大模型等场景下,英语与非英语之间的性能差距达4%-6%。为此,我们提出MultiLink框架,采用并行链接机制,结合多语言并行处理、思维链推理与检索增强生成,有效应对多语言结构差异。MultiLink在所有语言上均优于主流基线,英文执行准确率提升约15%,非英语平均提升10%。

原文摘要 · Abstract (English)

Natural language interfaces for NoSQL databases are increasingly vital in the big data era, enabling users to interact with complex, unstructured data without deep technical expertise. However, most recent advancements focus on English, leaving a gap for multilingual support. This paper introduces MultiTEND, the first and largest multilingual benchmark for natural language to NoSQL query generation, covering six languages: English, German, French, Russian, Japanese and Mandarin Chinese. Using MultiTEND, we analyze challenges in translating natural language to NoSQL queries across diverse linguistic structures, including lexical and syntactic differences. Experiments show that performance accuracy in both English and non-English settings remains relatively low, with a 4%-6% gap across scenarios like fine-tuned SLM, zero-shot LLM, and RAG for LLM. To address the aforementioned challenges, we introduce MultiLink, a novel framework that bridges the multilingual input to NoSQL query generation gap through a Parallel Linking Process. It breaks down the task into multiple steps, integrating parallel multilingual processing, Chain-of-Thought (CoT) reasoning, and Retrieval-Augmented Generation (RAG) to tackle lexical and structural challenges inherent in multilingual NoSQL generation. MultiLink shows enhancements in all metrics for every language against the top baseline, boosting execution accuracy by about 15% for English and averaging a 10% improvement for non-English languages.

自然语言查询多语言NoSQL基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。