arXiv:2412.12167cs.CLcs.AI2024-12

让说希腊语的人口述数学公式,自动生成LaTeX代码。

Greek2MathTex: A Greek Speech-to-Text Framework for LaTeX Equations Generation

  • 用语音识别+大模型,把希腊语数学表达转成LaTeX。
  • 系统支持自然语言口述,直接生成可编辑的公式代码。
  • 适合有视觉障碍或不熟悉编码的科研人员使用。

在绝大多数学术与科学领域,LaTeX已成为排版复杂数学公式和表达式的事实标准。然而,LaTeX复杂的语法和代码化外观对残障人士及不熟悉编程规范者构成了使用障碍。本文提出一种针对希腊语的全新语音转LaTeX公式系统。该系统采用端到端设计,结合自动语音识别(ASR)与自然语言处理(NLP)技术,使用户可通过自然语言口头输入数学表达式,系统将其转换为标准LaTeX格式。我们详细阐述了系统架构与设计原则,重点包括ASR引擎、基于大模型的提示驱动公式生成机制,以及在开发过程中使用的自定义评估指标。相关代码已开源,地址为https://github.com/magcil/greek-speech-to-math。

原文摘要 · Abstract (English)

In the vast majority of the academic and scientific domains, LaTeX has established itself as the de facto standard for typesetting complex mathematical equations and formulae. However, LaTeX's complex syntax and code-like appearance present accessibility barriers for individuals with disabilities, as well as those unfamiliar with coding conventions. In this paper, we present a novel solution to this challenge through the development of a novel speech-to-LaTeX equations system specifically designed for the Greek language. We propose an end-to-end system that harnesses the power of Automatic Speech Recognition (ASR) and Natural Language Processing (NLP) techniques to enable users to verbally dictate mathematical expressions and equations in natural language, which are subsequently converted into LaTeX format. We present the architecture and design principles of our system, highlighting key components such as the ASR engine, the LLM-based prompt-driven equations generation mechanism, as well as the application of a custom evaluation metric employed throughout the development process. We have made our system open source and available at https://github.com/magcil/greek-speech-to-math.

语音识别LaTeX生成无障碍

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。