OASIS让视频推理模型按需检索关键记忆,避免信息过载。
OASIS: On-Demand Hierarchical Event Memory for Streaming Video Reasoning

- 构建分层事件记忆库,仅在不确定时触发精准检索
- 长时序任务准确率提升,且每次检索延迟低
- 无需训练、可无缝接入多种视频大模型
流式视频推理面临历史无限增长而有效信息稀缺的挑战。相关信号如同沙漠中的绿洲——稀少、关键,却易被冗余淹没。单纯扩大记忆会加剧信息荒漠;过度压缩则会枯竭关键线索。真正难题在于知道该往哪里找,而非记住多少。为此,我们提出OASIS,一种面向流式视频推理的新框架,通过结构化、按需检索解决该问题。它将流式历史组织为分层事件,并采用受控精炼策略:先进行短上下文推理,仅当存在不确定性时才触发语义驱动的检索。由于检索基于高层意图而非嵌入相似性,所获记忆更准确、噪声更少。此外,该机制无需训练、即插即用,可灵活适配不同流式多模态大模型。在多个基准和模型上的实验表明,OASIS在保持有限令牌开销和低请求延迟的前提下,显著提升了长时程准确率与组合推理能力。代码已开源:https://github.com/Solus-sano/OASIS。
原文摘要 · Abstract (English)
Streaming video reasoning requires models to operate in a setting where history grows without bound while meaningful evidence remains scarce. In such a landscape, relevant signal is like an oasis-small, critical, and easily lost in a desert of redundancy. Enlarging memory only widens the desert; aggressive compression dries up the oasis. The real difficulty lies in discovering where to look, not how much to remember. We therefore introduce OASIS, a novel framework for streaming video reasoning that tackles this challenge through structured, on-demand retrieval. It organizes streaming history into hierarchical events and performs reasoning as controlled refinement-short-context inference first, followed by semantically grounded retrieval only when uncertainty arises. As the retrieval is driven by high-level intent rather than embedding similarity, the retrieved memory is substantially more accurate and less noisy. Additionally, the mechanism is plug-and-play, training-free, and readily attaches to different streaming MLLM backbones. Experiments across multiple benchmarks and backbones show that OASIS achieves strong gains in long-horizon accuracy and compositional reasoning with bounded token cost and low request delay. Code is available at https://github.com/Solus-sano/OASIS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。