用知识增强的分层索引,高效检索多语言医学视频。
Hierarchical Indexing with Knowledge Enrichment for Multilingual Video Corpus Retrieval
- 将视频字幕分块并注入知识图谱事实,构建多语言分层索引树。
- 在mVCR测试集上达领先性能,查询响应速度显著提升。
- 适合需要跨语言、高精度医学视频检索的研究与临床应用。
从多语言医学视频库中检索相关教学视频,对回答跨语言、多跳复杂问题至关重要。现有系统或将小时级视频压缩为粗粒度嵌入,或因细粒度匹配成本过高而难以实用。本文针对NLPCC-2025 M4IVQA挑战中的多语言视频语料检索(mVCR)任务,提出多阶段框架,融合多语言语义、领域术语与高效长文本处理。视频字幕被划分为语义连贯块,注入简洁的知识图谱(KG)事实,并组织成分层树结构,节点嵌入由语言无关的多语言编码器生成。查询时,相同编码器嵌入输入问题;通过粗到精的树搜索剪枝无关分支,仅对最相关块由轻量级大语言模型(LLM)重评分。该设计避免了全量交叉编码器计算,同时保持块级精度。在mVCR测试集上的实验表明性能达当前最优,消融研究证实了知识图谱增强、分层索引与针对性LLM重排序的互补贡献。所提方法为专业医学视频集合的多语言检索提供了精准且可扩展的解决方案。
原文摘要 · Abstract (English)
Retrieving relevant instructional videos from multilingual medical archives is crucial for answering complex, multi-hop questions across language boundaries. However, existing systems either compress hour-long videos into coarse embeddings or incur prohibitive costs for fine-grained matching. We tackle the Multilingual Video Corpus Retrieval (mVCR) task in the NLPCC-2025 M4IVQA challenge with a multi-stage framework that integrates multilingual semantics, domain terminology, and efficient long-form processing. Video subtitles are divided into semantically coherent chunks, enriched with concise knowledge-graph (KG) facts, and organized into a hierarchical tree whose node embeddings are generated by a language-agnostic multilingual encoder. At query time, the same encoder embeds the input question; a coarse-to-fine tree search prunes irrelevant branches, and only the top-ranked chunks are re-scored by a lightweight large language model (LLM). This design avoids exhaustive cross-encoder scoring while preserving chunk-level precision. Experiments on the mVCR test set demonstrate state-of-the-art performance, and ablation studies confirm the complementary contributions of KG enrichment, hierarchical indexing, and targeted LLM re-ranking. The proposed method offers an accurate and scalable solution for multilingual retrieval in specialized medical video collections.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。