arXiv:2410.16148cs.IRcs.AI2024-10被引 14

自动生成播客章节标题与时间戳,提升长音频内容浏览体验。

PODTILE: Facilitating Podcast Episode Browsing with Auto-generated Chapters

  • 用细调的编码器-解码器模型同时识别章节切分点和生成标题。
  • 在16000词长的播客转录文本上,ROUGE分数比基线高11%。
  • 适合想快速定位内容的听众,尤其对冷门播客帮助显著。

长时长谈话类音频(如播客)听众常难以把握整体结构或定位相关内容。将节目划分为带标题和时间戳的章节是实用解决方案。然而,当前Spotify平台多数播客缺乏创作者提供的章节,自动化生成至关重要。该任务面临两大挑战:一是对话内容较书面文本更松散,转折微妙;二是转录文本通常长达约16,000个词元,需高效处理并保留上下文。为此,我们提出PODTILE,一种微调的编码器-解码器变压器模型,可同时生成章节切分点与标题。为保留上下文,输入文本融合了节目标题、描述及前序章节标题。内在评估显示,PODTILE在ROUGE指标上相较最强基线提升11%。此外,实证表明自动生成章节有助于听众探索非热门播客。最后,我们验证了章节标题能有效提升稀疏检索在搜索任务中的表现。

原文摘要 · Abstract (English)

Listeners of long-form talk-audio content, such as podcast episodes, often find it challenging to understand the overall structure and locate relevant sections. A practical solution is to divide episodes into chapters--semantically coherent segments labeled with titles and timestamps. Since most episodes on our platform at Spotify currently lack creator-provided chapters, automating the creation of chapters is essential. Scaling the chapterization of podcast episodes presents unique challenges. First, episodes tend to be less structured than written texts, featuring spontaneous discussions with nuanced transitions. Second, the transcripts are usually lengthy, averaging about 16,000 tokens, which necessitates efficient processing that can preserve context. To address these challenges, we introduce PODTILE, a fine-tuned encoder-decoder transformer to segment conversational data. The model simultaneously generates chapter transitions and titles for the input transcript. To preserve context, each input text is augmented with global context, including the episode's title, description, and previous chapter titles. In our intrinsic evaluation, PODTILE achieved an 11% improvement in ROUGE score over the strongest baseline. Additionally, we provide insights into the practical benefits of auto-generated chapters for listeners navigating episode content. Our findings indicate that auto-generated chapters serve as a useful tool for engaging with less popular podcasts. Finally, we present empirical evidence that using chapter titles can enhance effectiveness of sparse retrieval in search tasks.

播客自动摘要语音处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。