用大模型重解意大利电视档案,自动生成讽刺性蒙太奇
AI Blob! LLM-Driven Recontextualization of Italian Television Archives
- 用LLM生成语义查询,动态检索1547段视频片段
- 基于主题重构内容,产出具有讽刺意味的叙事蒙太奇
- 适合媒体史、数字人文与AI创意研究者
本文介绍AI Blob!,一个实验性系统,探索语义目录与大语言模型(LLM)在档案电视影像检索与再语境化中的潜力。受意大利电视节目Blob(RAI Tre, 1989-)启发,AI Blob! 结合自动语音识别(ASR)、语义嵌入与检索增强生成(RAG),处理包含1,547个意大利电视视频的精选数据集。系统将音频转录为句子级单元,嵌入向量数据库以支持语义查询。用户输入主题提示后,LLM生成一系列语言与概念相关的查询,引导检索并重组音视频片段。算法筛选片段并构建叙事序列,模拟讽刺性并置与主题连贯性的编辑手法。该系统凸显内容感知的动态检索,超越静态元数据,推动档案新形式的自动化叙事构建与文化分析。项目为媒体史学与AI驱动档案研究提供概念框架与公开数据集,促进跨学科实验。
原文摘要 · Abstract (English)
This paper introduces AI Blob!, an experimental system designed to explore the potential of semantic cataloging and Large Language Models (LLMs) for the retrieval and recontextualization of archival television footage. Drawing methodological inspiration from Italian television programs such as Blob (RAI Tre, 1989-), AI Blob! integrates automatic speech recognition (ASR), semantic embeddings, and retrieval-augmented generation (RAG) to organize and reinterpret archival content. The system processes a curated dataset of 1,547 Italian television videos by transcribing audio, segmenting it into sentence-level units, and embedding these segments into a vector database for semantic querying. Upon user input of a thematic prompt, the LLM generates a range of linguistically and conceptually related queries, guiding the retrieval and recombination of audiovisual fragments. These fragments are algorithmically selected and structured into narrative sequences producing montages that emulate editorial practices of ironic juxtaposition and thematic coherence. By foregrounding dynamic, content-aware retrieval over static metadata schemas, AI Blob! demonstrates how semantic technologies can facilitate new approaches to archival engagement, enabling novel forms of automated narrative construction and cultural analysis. The project contributes to ongoing debates in media historiography and AI-driven archival research, offering both a conceptual framework and a publicly available dataset to support further interdisciplinary experimentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。