arXiv:2608.06027cs.CLcs.AI2026-08

用语音助手帮印度农村母亲填健康登记表,省时省钱还准。

FormBharo: Designing and Evaluating a Voice Agent for Conversational Form Filling in Rural India

论文配图:FormBharo: Designing and Evaluating a Voice Agent for Conversational Form Filling in Rural India
图 1 · 摘自论文原文
  • 用大模型+规则控制,在电话里自动填表,兼顾速度与成本。
  • 真实语音下准确率降41%,但规则校验能挽回多数错误。
  • 选模型不能只看单环节表现,得整体测试才能定最优方案。

在印度,几乎所有社会福利都始于表格,但最需要帮助的人往往不会读写。当前由一线健康工作者逐个录入,效率低下。我们开发了FormBharo(印地语意为“填表”),一个语音代理,在严格延迟和成本限制下,通过大语言模型(LLMs)与确定性规则验证及流程控制结合,完成结构化表格的电话填写。该系统正在与非营利组织ARMMAN合作试点,为低收入、讲印地语的母亲提供孕产期护理注册服务,据我们所知,这是首个针对该群体的语音填表系统。我们公开发布FormVoiceAgentBench基准,包含3,760次多轮对话测试,覆盖960次模拟通话,配有真人录制的印地语音频,用于评估语音转录、信息抽取、回复生成等组件性能及端到端表单完成度。当大模型使用有误的实录语音转写时,表单完成度下降约41分。规则控制可修复多数逐轮抽取错误,使小型廉价模型在表单完成度上达到甚至超越前沿模型。组件性能无法预测端到端表现:尽管GPT-5.5在参考转写上的抽取准确率达99.8%,但在表单完成任务中排名较低。由于错误在管道中会传播也会抵消,最佳模型选择需通过端到端评估得出。最终,没有单一模型能在准确率、成本与延迟上全部最优,因此我们采用基于帕累托的加权求和方法,选出兼顾三者的可部署配置。

原文摘要 · Abstract (English)

In India, almost every social benefit starts with a form, yet the people who need these benefits most are often unable to read or write. Reaching them requires a spoken conversation. Today that work falls to frontline health workers who enroll beneficiaries one at a time, a poor use of stretched capacity. We built FormBharo ("fill the form" in Hindi), a voice agent that fills a structured form over a phone call under tight latency and cost budgets by pairing Large Language Models (LLMs) with deterministic, rule-based validation and flow control. It is being piloted with ARMMAN, an NGO running large-scale maternal and child mobile-health programs in India, to enroll low-income, Hindi-speaking mothers in antenatal and postnatal care. To our knowledge, it is the first voice agent piloted to fill an enrollment form for this population. We openly release FormVoiceAgentBench, a benchmark pairing human-recorded Hindi audio with 3,760 multi-turn conversation tests across 960 simulated calls, to evaluate our agent's components (transcription, extraction, reply generation) and end-to-end form completion under real acoustic variations. Form completion drops by up to ~41 points when LLMs receive error-prone real-speech transcripts instead of reference ones. The rule-based controls recover many turn-level extraction errors, helping smaller, cheaper models match or surpass frontier models on form completion. Component performance does not predict end-to-end performance: GPT-5.5 leads turn-level extraction accuracy on reference transcripts (99.8%) but ranks lower on form completion. Since errors both propagate and cancel across the pipeline, the optimal model choice of models emerges only through end-to-end evaluation. Finally, no single model is best across accuracy, cost, and latency at once, so we use a Pareto-based weighted-sum scalarization to select a deployable configuration balancing the three.

语音代理填表自动化农村医疗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。