用检索增强提示提升语音事件抽取效果,性能优于现有方法。
Retrieval-Enhanced Few-Shot Prompting for Speech Event Extraction
- 分步处理:先筛选含事件的语音段,再用检索增强的少样本提示提取信息。
- o1-mini模型在触发词分类上达63.3% F1,论元分类达27.8% F1。
- 适合需要可解释性与模块化设计的语音信息抽取场景。
语音事件抽取(SpeechEE)是自动语音识别(ASR)与自然语言处理(NLP)交叉的挑战任务,需从口语中提取结构化事件信息。本文提出一种模块化、流水线式SpeechEE框架,融合高性能ASR与语义搜索增强的大型语言模型(LLM)提示。系统首先通过规则、BERT及LLM联合构建的混合过滤机制,识别可能包含事件的语音片段;随后采用少样本LLM提示,并结合语义相似度检索动态增强,完成事件触发词识别与论元抽取。我们使用多个LLM(Llama3-8B、GPT-4o-mini、o1-mini)进行评估,结果表明o1-mini表现最佳,触发词分类F1达63.3%,论元分类F1达27.8%,超越已有基准。实验显示,结合检索增强的流水线方法在性能上可媲美甚至超过端到端系统,同时保持可解释性与模块化优势。该工作为基于LLM的事件抽取提供了实用洞见,也为未来融合文本与声学特征的混合模型开辟了路径。
原文摘要 · Abstract (English)
Speech Event Extraction (SpeechEE) is a challenging task that lies at the intersection of Automatic Speech Recognition (ASR) and Natural Language Processing (NLP), requiring the identification of structured event information from spoken language. In this work, we present a modular, pipeline-based SpeechEE framework that integrates high-performance ASR with semantic search-enhanced prompting of Large Language Models (LLMs). Our system first classifies speech segments likely to contain events using a hybrid filtering mechanism including rule-based, BERT-based, and LLM-based models. It then employs few-shot LLM prompting, dynamically enriched via semantic similarity retrieval, to identify event triggers and extract corresponding arguments. We evaluate the pipeline using multiple LLMs (Llama3-8B, GPT-4o-mini, and o1-mini) highlighting significant performance gains with o1-mini, which achieves 63.3% F1 on trigger classification and 27.8% F1 on argument classification, outperforming prior benchmarks. Our results demonstrate that pipeline approaches, when empowered by retrieval-augmented LLMs, can rival or exceed end-to-end systems while maintaining interpretability and modularity. This work provides practical insights into LLM-driven event extraction and opens pathways for future hybrid models combining textual and acoustic features.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。